-- Logs begin at Thu 2021-12-23 11:17:09 UTC, end at Thu 2021-12-23 12:21:40 UTC. -- Dec 23 11:45:05.401393 dv-cinder-822821-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 23 11:45:05.412012 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Dec 23 11:45:05 2021] *** Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: nodename: dv-cinder-822821-1-iscsi Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: machine: x86_64 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: clock source: unix Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: pcre jit disabled Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: detected number of CPU cores: 4 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: current working directory: / Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: detected binary path: /usr/bin/uwsgi-core Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: your processes number limit is 47680 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: your memory page size is 4096 bytes Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: detected max file descriptor number: 2048 Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: lock engine: pthread robust mutexes Dec 23 11:45:05.414181 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: thunder lock: enabled Dec 23 11:45:05.415078 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 23 11:45:05.415078 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 23 11:45:05.458422 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: Python main interpreter initialized at 0x55c1951ee9c0 Dec 23 11:45:05.458422 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: python threads support enabled Dec 23 11:45:05.458422 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: your server socket listen backlog is limited to 100 connections Dec 23 11:45:05.458422 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: your mercy for graceful operations on workers is 90 seconds Dec 23 11:45:05.458858 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: mapped 403077 bytes (393 KB) for 2 cores Dec 23 11:45:05.458936 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: *** Operational MODE: preforking *** Dec 23 11:45:05.459191 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: *** uWSGI is running in multiple interpreter mode *** Dec 23 11:45:05.459191 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: spawned uWSGI master process (pid: 79177) Dec 23 11:45:05.459427 dv-cinder-822821-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 23 11:45:05.462135 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: spawned uWSGI worker 1 (pid: 79189, cores: 1) Dec 23 11:45:05.462135 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: spawned uWSGI worker 2 (pid: 79190, cores: 1) Dec 23 11:45:05.462135 dv-cinder-822821-1-iscsi devstack@keystone.service[79177]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 23 11:45:10.778668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:45:10.778668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: from cryptography.utils import int_from_bytes Dec 23 11:45:10.779490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:45:10.779490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: from cryptography.utils import int_from_bytes Dec 23 11:45:10.780860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:45:10.780860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: from cryptography.utils import int_from_bytes Dec 23 11:45:10.781347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 23 11:45:10.781347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: from cryptography.utils import int_from_bytes Dec 23 11:45:10.828200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:45:10.828415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:45:10.828566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] command line args: [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:45:10.828794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:45:10.828996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ================================================================================ {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:45:10.829246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] admin_token = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.829487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] config_dir = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.829648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.829854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] config_source = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.829976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 23 11:45:10.830063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] debug = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.830140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 23 11:45:10.830207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.830420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] command line args: [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 23 11:45:10.830556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.830644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 23 11:45:10.830807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.830884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ================================================================================ {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 23 11:45:10.830984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] admin_token = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] config_dir = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] config_source = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_config_append = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] debug = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.831941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_dir = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_file = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.832845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_config_append = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_dir = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_file = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.833949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.834915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.835946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] publish_errors = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.836907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] standard_threads = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.837660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] publish_errors = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] use_journal = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] use_json = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] use_stderr = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] use_syslog = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.838964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.839270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] standard_threads = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.839454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.839670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.839809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] use_journal = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.839879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.839953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] use_json = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.840108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] use_stderr = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.840189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.840265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] use_syslog = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.840336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.840459 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 23 11:45:10.840548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.840715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.840830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.840957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.841936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.842897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.843938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.844987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.845874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.846892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.847921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.848957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.849955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.850992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.851874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.852937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.853931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.854871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.855920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.856921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857505 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.857908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.858944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.859944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.external = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.860996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.password = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] auth.token = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.861924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.862967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.external = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.863896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.password = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] auth.token = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.864994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.865991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.866945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.867943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.868892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.869946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.870948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.871879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.872951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873785 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.873904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.874913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875859 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.875973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.876919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.877975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.878970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.879999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.880925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.881961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.882918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.883951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.884995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.885904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.886877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.887940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.888984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889857 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.889970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.890799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.891993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.892888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] role.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] role.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.893994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.894970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.895982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] role.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] role.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.896911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.897924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.898996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.899912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.900944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.901968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.902915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.903933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.904968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.connection = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.905988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.906958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907762 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.907884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.908928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.connection = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:45:10.909961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.909961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.910475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.910475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.910729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.910900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.911150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.911388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.911634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.911865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.912107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.912343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 23 11:45:10.912514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 23 11:45:10.938108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.938366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.938616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.941137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.941372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.941601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.947131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.950194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.976921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.977106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.978717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:10.978959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.030344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.031711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.079281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.079483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.081483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.081709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.146853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.147958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.148210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.148426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.148646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.170976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.171908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.172870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.173075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.183311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.184090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.196881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.197937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 23 11:45:11.214321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.214482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 23 11:45:11.214868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.214995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.215074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 23 11:45:11.215139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 23 11:45:11.215284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 23 11:45:11.216925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.216999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.217109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.219170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.229969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.230244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.230504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.230812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.233028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.233346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.233628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.233908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.238975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.242390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.242541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.242746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.243020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.243288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.243556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.243790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.244051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.244337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.244600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.244862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.245138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.245598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.245875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.246152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.246428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.246732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.246992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.247257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.247528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.247795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.248063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.248323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.271250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.272811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.273090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.275623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.277232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.277515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.280322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.280708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.280938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.284963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.285271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.285515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.288090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.288400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.292731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.292858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.292998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.293101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.293272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.293542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.293811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.294079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.294339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.294627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.297967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.298249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.298537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.298832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.299103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.299377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.299648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.299915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.312975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.313247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.317648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.318411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.318709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.321266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.321558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.323134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.326363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.326826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.327695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.330089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.332592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.333652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.334000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.334213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.334497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.334786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.335078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.336112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.339719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.340012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.340289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.340573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.340847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.341146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.353808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.354165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.354322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.354585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.361631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.361940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.362205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.362463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.363510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.365649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.365910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.368895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.369145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.369537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.369851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.370128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.370638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.372720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.372988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.376253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.376494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.376927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.377211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.377522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.384867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.385145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.385423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.385697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.385973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.386255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.386547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.395646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.395911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.396218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.396497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.396777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.397048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.397331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.404093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.407502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.410855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.412414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.413982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.414255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.414532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.415181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.418370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.421622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.421847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.423276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.423402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.425039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.425315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.425572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.426525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.426810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.427092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.427376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.432777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.434364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.436546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.436851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.437265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.437723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.438011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.438292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.438570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.445028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.445301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.445557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.445846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.446109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.446395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.446657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.446916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.447222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.447480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.447604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.447740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.447879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.447999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.448115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.448229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.448483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.456128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 23 11:45:11.456406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.456679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.456952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.457212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.457480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.457760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.458034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.458306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.458572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.458839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.459116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.459410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.459682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 23 11:45:11.485691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1951ee9c0 pid: 79189 (default app) Dec 23 11:45:11.489289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f572be-e845-4780-b477-a388e82d62c0 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:11.489576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f572be-e845-4780-b477-a388e82d62c0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:11.489845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f572be-e845-4780-b477-a388e82d62c0 None None] PATH_INFO: `/v3` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:11.494365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Thu Dec 23 11:45:11 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:11.499110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1951ee9c0 pid: 79190 (default app) Dec 23 11:45:19.443655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:19.444205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:19.444205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:19.446374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:19.457315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:19.457854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:19.457937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:19.500848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG oslo_db.sqlalchemy.engines [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:45:19.704224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG passlib.handlers.bcrypt [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79190) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 23 11:45:19.704557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG passlib.handlers.bcrypt [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79190) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 23 11:45:19.761417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:19.763088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:19.912479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1/3] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:20.081772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:20.121430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG oslo_db.sqlalchemy.engines [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 23 11:45:20.257734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5499c-3f8d-405b-8827-10dd0525176d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:20.263239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:20.263903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:20.264178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:20.264697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:20.276090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:20.338678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 23 11:45:20.338930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0559da-80f8-408d-a5a4-633a2939fed3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:20.350937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:20.360235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:20.380656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707fef4-2923-4b6a-84c4-d326a0ce7527 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:20.386476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:20.387658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:20.387935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:20.388206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:20.392591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:20.443018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 23 11:45:20.443352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be70b2-d1f1-4a70-8052-683e0450d4c3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:20.448116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 2/5] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:20 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:22.788986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726e41-7864-491f-a7a7-64657a7fadff None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:22.789796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726e41-7864-491f-a7a7-64657a7fadff None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:22.789910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63726e41-7864-491f-a7a7-64657a7fadff None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:22.799132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 4/6] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:22 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:22.805955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:22.806383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:22.806467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:22.826604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:22.828454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:22.838310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 3/7] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:22.863612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726e41-7864-491f-a7a7-64657a7fadff None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:22.878071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63726e41-7864-491f-a7a7-64657a7fadff None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:22.884176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:22.884814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:22.885204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:22.885478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:22.894026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:22.895827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d886578-69e3-4175-9e9b-17bec046ab4d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:22.905179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 5/8] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:22 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:22.912147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:22.925776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2054e-f7e6-4853-9ef9-dcc17ccfbae7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:22.932345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:22.933253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:22.933534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:22.933808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:22.935508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:22.937875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764fdc4-d217-4c60-8902-a84a208d9734 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:22.939491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 4/9] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:22 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:25.362275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216d7d-1131-4377-9fb0-fcde942387c9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.362778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216d7d-1131-4377-9fb0-fcde942387c9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.362862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216d7d-1131-4377-9fb0-fcde942387c9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.364633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:25.370729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7295-0fd5-43cd-927f-87602e17db34 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.371152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7295-0fd5-43cd-927f-87602e17db34 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.371309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca7295-0fd5-43cd-927f-87602e17db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.390855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8aca7295-0fd5-43cd-927f-87602e17db34 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:25.392055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8aca7295-0fd5-43cd-927f-87602e17db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:25.400414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 5/11] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:25.407855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13703-87e6-499e-830e-24ead11ebfe5 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.408142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13703-87e6-499e-830e-24ead11ebfe5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.408417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b13703-87e6-499e-830e-24ead11ebfe5 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.410318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 7/12] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:25.416095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.416388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.416668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.424173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13703-87e6-499e-830e-24ead11ebfe5 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.435518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:25.435885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b13703-87e6-499e-830e-24ead11ebfe5 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.436812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:25.440621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.441430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.441710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.441979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.445415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 6/13] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:25.458707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:25.465576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:25.466836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 8/14] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:45:25.469406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.474534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.480028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e915de-4ae4-4ac5-b1d2-b9a0dcbdb855 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.485133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe18-d224-45a4-b805-6b4cdc283b05 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.485249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.485810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.486099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.486377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.490198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.491232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.491550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.491808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.492571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:25.492870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.494681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:25.494681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:25.494681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:25.494938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.495586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.496671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.505462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 7/15] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:25.510417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 9/16] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:25.511678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.516533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.520838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d551e56-0603-4c57-b644-2f145c1c3ae6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.526079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.526911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.527193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.527452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c7d2-ae96-4137-a9e0-d01d2d062df0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.527579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.528728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.530548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.532136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 8/17] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:25.533174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.533997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.534249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.534536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.536420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.538305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.540147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 10/18] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:25.547057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.558369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2c6a-b538-4b7c-b391-41d0e919ee7c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.564803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.565631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.565917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.566190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.567621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.569398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0704136-e658-4589-8510-8b276c6b6732 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.571161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 9/19] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:25.578157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:25.589996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ccb50-d979-48f3-85d5-0421161b3abf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:25.596844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:25.597504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:25.597808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:25.598078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:25.598990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.domain.id=default, user.id=9398b24434c441718ba35a7f98df482a) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:25.599298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:25.600350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:25.600350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:25.600350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:25.601546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54e839-9c7a-4a0a-983b-3c857796b6a3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:25.612970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1343 bytes} [Thu Dec 23 11:45:25 2021] GET /identity/v3/role_assignments?user.id=9398b24434c441718ba35a7f98df482a&scope.domain.id=default&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 233 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:28.215821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec0e-0510-4896-9525-e468007a5c0f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.216367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec0e-0510-4896-9525-e468007a5c0f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.216442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ec0e-0510-4896-9525-e468007a5c0f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.219304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:28.225559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.226019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.226198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.276620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG passlib.handlers.bcrypt [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79189) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 23 11:45:28.277039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG passlib.handlers.bcrypt [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79189) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 23 11:45:28.322928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:28.324687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:28.353075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 12/22] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:28.391502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ec0e-0510-4896-9525-e468007a5c0f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:28.404662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ec0e-0510-4896-9525-e468007a5c0f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:28.414354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:28.415220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.415502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.415772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.429358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:28.431232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:28.448807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:45:28.450427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 11/23] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:28.456450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:28.466603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df532012-0b77-4720-86a0-1bb9d4aafd99 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:28.475073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:28.476203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.476493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.476772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.477705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:28.478010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:28.479126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:28.479126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:28.479126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:28.480061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814f489-d5ba-4ec9-b383-7b43f0edd2af admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:28.511760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 13/24] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:45:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:28.517821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:28.524198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facbf7-fec8-4fe9-a563-6e058a495339 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.524483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facbf7-fec8-4fe9-a563-6e058a495339 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.524760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facbf7-fec8-4fe9-a563-6e058a495339 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.526814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 14/25] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:28.528182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf1d44-c468-4dcb-8a52-07aa2231c756 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:28.534659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.534944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.535219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.537125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:28.537801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.538088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.538366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.539228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:28.541105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:28.541105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:45:28.541105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:45:28.542439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255757cd-a39d-4545-9dbe-c0c3811af208 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:28.567900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:28.569161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:28.594159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 15/26] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:28.630253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:28.644460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f561-8cf4-42e0-a8d6-5efe0f7ca8b3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:28.658150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:28.658881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.659165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.659442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.660306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:28.661367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:28.661367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:28.661367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:28.662311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:28.856394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 12/27] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:45:28 2021] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:28.858268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15badaa0-6a85-4868-a3ba-d4ac365057ac None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.866754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15badaa0-6a85-4868-a3ba-d4ac365057ac None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.867243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15badaa0-6a85-4868-a3ba-d4ac365057ac None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.869821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 13/28] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:28 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:28.879750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:28.880048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:28.880300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:28.912612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:28.914454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:29.019155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 14/29] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:29.022932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 16/30] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:45:28 2021] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:29.058663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.069019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0736d9-c110-4823-bee6-bc0eb4c0535b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.078695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.079540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.079824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.080096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.100089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:29.107592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:29.110255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 15/31] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:29.117238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.140341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1282b-3549-40da-bf27-d7e28f20b10c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.151206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.151899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.152182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.152458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.153244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:29.153547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:29.155526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:29.174106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 17/32] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:29.180948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.191474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03154e-d5f4-4f2b-9940-7079d3a86109 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.196308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.197214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.197510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.197826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.199213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:29.201457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:29.203679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 16/33] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:29 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:29.210018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.225169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997809af-b0a6-4b52-8eb3-d88162083de2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.235341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.236161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.236443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.236717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.243819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:29.245584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006e778-5641-43dd-b997-51e7a5f74aa1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:29.247724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 18/34] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:29.253801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.268701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffe9e3-83f2-4548-99ab-46dfa98aa2ef admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.278716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.279651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.280120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.280406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] PATH_INFO: `/v3/domains/default/users/9398b24434c441718ba35a7f98df482a/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.282863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9398b24434c441718ba35a7f98df482a, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:29.284016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:29.284016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:45:29.284016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:45:29.286047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baa8d-aa1d-4329-a111-e8db91e7ea5b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:29.308060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1382 bytes} [Thu Dec 23 11:45:29 2021] PUT /identity/v3/domains/default/users/9398b24434c441718ba35a7f98df482a/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:29.532757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c38d-1982-49ae-b6fd-f29a7b281584 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.533082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c38d-1982-49ae-b6fd-f29a7b281584 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.533302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92c38d-1982-49ae-b6fd-f29a7b281584 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.535253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:29.541990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f9c2-6f71-4f87-a922-e82c7cd14b67 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.542320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f9c2-6f71-4f87-a922-e82c7cd14b67 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.542567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f9c2-6f71-4f87-a922-e82c7cd14b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.563186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4b80f9c2-6f71-4f87-a922-e82c7cd14b67 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:29.564455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4b80f9c2-6f71-4f87-a922-e82c7cd14b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:29.635394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 18/37] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:29.659691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92c38d-1982-49ae-b6fd-f29a7b281584 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:29.677117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92c38d-1982-49ae-b6fd-f29a7b281584 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:29.684401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:29.685532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.686121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.686705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.687738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:29.689692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462aaf9-2707-4bb9-9d68-c26cadcf8438 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:29.710966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 20/38] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:45:29 2021] POST /identity/v3/roles => generated 225 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:29.958539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fc46-39c0-4f4b-80c7-fe5b9bd2c6ee None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.958884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fc46-39c0-4f4b-80c7-fe5b9bd2c6ee None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.959056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f591fc46-39c0-4f4b-80c7-fe5b9bd2c6ee None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.961093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 19/39] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:29.966943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:29.967271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:29.967553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:29.987811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:29.989317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:29.997482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 21/40] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:30.021772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591fc46-39c0-4f4b-80c7-fe5b9bd2c6ee None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:30.033972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f591fc46-39c0-4f4b-80c7-fe5b9bd2c6ee None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:30.038126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:30.038953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:30.039235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:30.039504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:30.040677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:30.042398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0942715-3882-4d25-af5c-ca4ddb90d87e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:30.044217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 20/41] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:30.049856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:30.058943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf9ff-8c69-4523-87f8-0d6d4c1a381b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:30.063863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:30.064528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:30.064809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:30.065085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:30.065824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:30.066867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:30.066867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:30.066867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:30.068090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:30.092417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95df1-63b1-4157-b887-da52908bbf34 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:30.092922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95df1-63b1-4157-b887-da52908bbf34 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:30.092922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95df1-63b1-4157-b887-da52908bbf34 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:30.095554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 21/42] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:30.101865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429d641-11f5-4af0-9233-2459399eafe6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:30.102303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429d641-11f5-4af0-9233-2459399eafe6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:30.107754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429d641-11f5-4af0-9233-2459399eafe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:30.107965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 22/43] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:45:30 2021] POST /identity/v3/projects => generated 312 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:30.130326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9429d641-11f5-4af0-9233-2459399eafe6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:30.131583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9429d641-11f5-4af0-9233-2459399eafe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:30.197907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 22/44] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:30.221803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:30.232066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573236ed-399f-422d-a8eb-538df0e60c5d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:30.236883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:30.237603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:30.237861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:30.238133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:30.238962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:30.240946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cdae0-8ee9-4a86-b22c-ef627e6b2641 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:30.256470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:45:30 2021] POST /identity/v3/roles => generated 223 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:31.863344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27af0-5968-4310-afe6-e3884e484bb0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:31.863896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27af0-5968-4310-afe6-e3884e484bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:31.863896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c27af0-5968-4310-afe6-e3884e484bb0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:31.866001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 23/46] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:31.871894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:31.872336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:31.872456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:31.891228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:31.892433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:31.900693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 24/47] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:31.924510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c27af0-5968-4310-afe6-e3884e484bb0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:31.937525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c27af0-5968-4310-afe6-e3884e484bb0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:31.942261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:31.943108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:31.943395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:31.943671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:31.955197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:31.962112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:31.963540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 24/48] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:31.969932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:31.979214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec958a73-c73e-42ef-9668-41b9f341f08a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:31.984154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:31.984830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:31.985115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:31.985391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:31.986174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:31.986483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:31.988152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:31.997125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:32.003344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:32.013865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e87f-10ec-4439-96e0-c50839aed6aa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:32.019819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:32.020835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.021180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.021485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.022857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:32.024728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:32.026369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 25/50] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:32 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:32.032440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:32.042845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e740f0d-e61e-4368-b116-e868e7124c3e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:32.047977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:32.048786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.049067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.049340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.050542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:32.052310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f176fd-2ae2-46a5-adc9-7bf117d471e0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:32.053890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 26/51] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:32.060263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:32.070995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb927f6-ae71-4268-9341-0678ba12bc0a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:32.076205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:32.076950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.077231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.077486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.078340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.domain.id=default, user.id=9398b24434c441718ba35a7f98df482a) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:32.078674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:32.079706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:32.079706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:45:32.079706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:45:32.080883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2969-8116-4784-9639-6b3e2a255349 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:32.089111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1343 bytes} [Thu Dec 23 11:45:32 2021] GET /identity/v3/role_assignments?user.id=9398b24434c441718ba35a7f98df482a&scope.domain.id=default&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 530 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:32.504606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d8d0-200c-4a65-96b6-bf74f8338f4f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.505054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d8d0-200c-4a65-96b6-bf74f8338f4f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.505542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13d8d0-200c-4a65-96b6-bf74f8338f4f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.508521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 27/53] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:32.518119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.518480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.518942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.542100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:32.543339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:32.552745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 27/54] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:32.577703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13d8d0-200c-4a65-96b6-bf74f8338f4f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:32.597776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13d8d0-200c-4a65-96b6-bf74f8338f4f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:32.603524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:32.604329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.604614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.604896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.606181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:32.608340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f5a8-b21d-4cf3-8e5b-3132dcd09a22 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:32.610014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:32.616846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:32.626844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb78a80-06b6-4db0-a88f-67b581e1ed42 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:32.632014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:32.632677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:32.632959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:32.633235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:32.633962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:32.635995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0bd5f-eb57-4c7b-8ebf-072a78ae8aa0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:32.669655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 28/56] 10.222.0.65 () {60 vars in 1161 bytes} [Thu Dec 23 11:45:32 2021] POST /identity/v3/projects => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:35.071025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976088-e574-4828-9c94-f45638419ee2 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:35.071901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976088-e574-4828-9c94-f45638419ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:35.071901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976088-e574-4828-9c94-f45638419ee2 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:35.074862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 29/57] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:35.081507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070429-c16a-4759-b0c7-875715615c81 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:35.081925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070429-c16a-4759-b0c7-875715615c81 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:35.082048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070429-c16a-4759-b0c7-875715615c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:35.101499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-33070429-c16a-4759-b0c7-875715615c81 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:35.102759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-33070429-c16a-4759-b0c7-875715615c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:35.166720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 29/58] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:35.192238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976088-e574-4828-9c94-f45638419ee2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:35.207819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976088-e574-4828-9c94-f45638419ee2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:35.213713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:35.214500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:35.214810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:35.215086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:35.216457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:35.218134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea3075-18d1-479d-9241-2fdc5f6d673b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:35.219730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 30/59] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:35.226254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070429-c16a-4759-b0c7-875715615c81 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:35.238616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070429-c16a-4759-b0c7-875715615c81 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:35.244426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:35.245095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:35.245391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:35.245670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:35.246420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:35.247581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:35.247581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:45:35.247581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:45:35.249032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece6616-33ab-4faa-b51b-7ad868483a71 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:35.280726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 30/60] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:35 2021] POST /identity/v3/users => generated 275 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:38.985932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e18c6-72fe-41d6-8e27-5063bb35b3e7 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:38.986938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e18c6-72fe-41d6-8e27-5063bb35b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:38.987369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e18c6-72fe-41d6-8e27-5063bb35b3e7 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:38.989636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 31/61] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:38.995987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f4aa-b39a-4df6-9905-cbca09d0ec4f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:38.996525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f4aa-b39a-4df6-9905-cbca09d0ec4f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:38.996525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f4aa-b39a-4df6-9905-cbca09d0ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.023516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-18f2f4aa-b39a-4df6-9905-cbca09d0ec4f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:39.024752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-18f2f4aa-b39a-4df6-9905-cbca09d0ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:39.033157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 31/62] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:39.066695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e18c6-72fe-41d6-8e27-5063bb35b3e7 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.076131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73485554-a31d-4c7b-a9a7-4b641d0eb4c0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.076768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73485554-a31d-4c7b-a9a7-4b641d0eb4c0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.077352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73485554-a31d-4c7b-a9a7-4b641d0eb4c0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.080443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 32/63] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:39.086353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.087170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.087644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.091209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e18c6-72fe-41d6-8e27-5063bb35b3e7 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.096039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.097050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.097487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.097910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.107794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:39.109328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:39.121009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:39.129264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:39.131896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 32/64] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:39.138097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 33/65] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:39.139287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.149818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1513b-b543-4aa7-ae59-31f9a9b4cfff admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.161892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.167766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.168742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.169236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.169717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.170782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.171308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.171802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fbb0a-ace5-4566-a0f2-367f3d901c6f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.173314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.176611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.177591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.178012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.178424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.190129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:39.193168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 33/66] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.198083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:39.198993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.199758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 34/67] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:45:39.205869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.216637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80709d1-add9-4c8e-98ee-e3186eae0308 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.221436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15476-19a0-4d4a-905c-111856c522ee admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.222172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.223170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.223611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.224028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.224958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.225432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.226728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:39.226728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:45:39.226728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:45:39.227940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.232480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.233102 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.233397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.233675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.243176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 35/68] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:39.258208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.260782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.263076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:39.263580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.274543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.283314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1c7f3-cf17-4425-98a8-3d384e04616e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.289304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9887f-50cc-49f7-8976-8e5aa55a7008 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.292850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.293744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.294028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.294304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.298645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.300874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43182da-6e0b-4f83-8b52-9903bb843bb5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.302751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 36/70] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.303303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.304317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.304760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.305188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.312179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460ac39-b1aa-4850-ab6e-4d12b095b46c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.312465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460ac39-b1aa-4850-ab6e-4d12b095b46c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.312742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460ac39-b1aa-4850-ab6e-4d12b095b46c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.314566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 37/71] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:39.315268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460ac39-b1aa-4850-ab6e-4d12b095b46c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.316420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.318381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda3ab1-c7eb-4d4e-be7c-675a8b41a89b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.328775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 35/72] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:39.330045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.330493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.330956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.333475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460ac39-b1aa-4850-ab6e-4d12b095b46c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.338831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.339654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.340083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.340499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.349625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.351659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.352917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:39.354203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:39.362884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 36/73] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:39.363992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.371628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 38/74] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:39.374122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b52292-a21a-43c1-bf90-9d89ef62044b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.376836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.386416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.387778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.390131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c7136-ff8b-4a07-8a4f-2056e388338a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.390674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.391167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.392661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.396708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.398456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.399008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.399425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.399698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.399807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.399966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.401257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.403534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4a369-2601-4dbc-b95c-7d13ebce9807 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.405388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:39.406755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9fe3-1ee4-469b-85a0-fb8584138b28 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.407040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9fe3-1ee4-469b-85a0-fb8584138b28 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.407317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9fe3-1ee4-469b-85a0-fb8584138b28 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.408976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 40/77] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:39.412351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9fe3-1ee4-469b-85a0-fb8584138b28 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.415467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937603f-3cc2-4ad6-8c15-716a4a438f56 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.420119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.421203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.421451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.421718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.425788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9fe3-1ee4-469b-85a0-fb8584138b28 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.430174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.430819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.431105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.431380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.432336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:39.432451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.432529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.434399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e64f-3997-4fac-8819-2773d5719ae1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.439274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:39.440713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 38/78] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:39.441294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 41/79] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.442268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.442630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a698-2b2d-403b-aab1-1d51b02a6676 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.443230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a698-2b2d-403b-aab1-1d51b02a6676 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.443645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a698-2b2d-403b-aab1-1d51b02a6676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.455332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c6f2d-e9e2-41eb-9a24-1fcd9a1f1492 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.461653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.462627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.463752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.464200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.465318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.465779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.467945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.469083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-29f1a698-2b2d-403b-aab1-1d51b02a6676 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:39.470316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-29f1a698-2b2d-403b-aab1-1d51b02a6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:39.474551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 39/80] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.475359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.478179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 42/81] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:39.479440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61badabb-272e-46c9-9b7b-2571b75deb83 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.479729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61badabb-272e-46c9-9b7b-2571b75deb83 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.480001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61badabb-272e-46c9-9b7b-2571b75deb83 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.481920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 43/82] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:39.488312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.488593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.489029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.492798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f39c6-5dda-4434-be03-40cd53295909 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.497723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.498543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.498919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.499265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.500135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.500519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.502280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.511231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:39.512691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:39.513016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 40/83] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.514017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.528900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2af5c5-60b7-42e0-87f0-94786f5a6d8b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.532369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 44/84] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:39.533052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.542561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.543638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.544066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.544491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.546171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540584f-77c4-4dee-bfac-0c3447d35579 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.546551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.548498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.550925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 41/85] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.554803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.556248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.557388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.558095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.558673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.560403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.562757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.565148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 45/86] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.571659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.572847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab012d-6a92-4ae3-962a-2e09e565f075 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.579116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.580236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.580713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.581192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.582169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.583506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:39.583506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:39.583506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:39.583841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031823f8-80c5-42b7-b7e0-23106e3faddd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.585408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.589155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.590108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.590623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.591059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.601196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.603444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.617458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 46/87] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:45:39.619097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.633500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 42/88] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:39 2021] POST /identity/v3/users => generated 289 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:39.635527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.640097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4327fe-527e-4b38-a57b-ac5c54b4a2cc admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.653819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.655648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.658779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee472-9f1a-4d26-85eb-c0f4ebf5b3c4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.659449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.659866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.671835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.673668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.675372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.677270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.679783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.682805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.685028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 43/89] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:39.691388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:39.692393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.698677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:39.705780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 47/90] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:39.706033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459d43-dea4-45bf-b092-631c734d8e76 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.714729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.715691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.715909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.716454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.716964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.718249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=9398b24434c441718ba35a7f98df482a) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.718765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.721102 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.727998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 44/91] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/role_assignments?user.id=9398b24434c441718ba35a7f98df482a&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:39.737447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a599c3-8bb1-4978-a207-1675cd86e23d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.746352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.747341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.747823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.748357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.749444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.749920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.751789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.770734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 48/92] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.777913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.789898 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b4e58-2f21-4faa-82bc-0ef5c02ec23e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.795277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.796752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.797249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.797748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.799474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.802025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.804228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 45/93] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.812051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.822742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486d6fd-df03-48cb-a92c-66a479f44a8b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.835593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.836301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.836586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.836885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.851379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.853196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.869407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 49/94] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:45:39.876219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.893169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af88d-ee4f-4027-9d7d-4540b7dc3b34 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.907403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.908332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.908603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.908880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] PATH_INFO: `/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.910255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] RBAC: Authorizing `identity:get_project(project_id=3f896cc6e6ba425b9dcfc59863eeda65)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.912448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aece9f-89c7-46b5-b120-39c30de6ea0f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.914242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 46/95] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65 => generated 312 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:39.920599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:39.930285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff056353-105d-4454-a425-75842b46f7c6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:39.939115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:39.939784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:39.940063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:39.940334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:39.941186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=3f896cc6e6ba425b9dcfc59863eeda65, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:39.941496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:39.943551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d89f6-92e4-47aa-bf19-3f6283f66876 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:39.950990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 50/96] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:39 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=3f896cc6e6ba425b9dcfc59863eeda65&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:42.344411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b09b-61b2-4de1-a707-884b003e1ce7 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.347595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b09b-61b2-4de1-a707-884b003e1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.347595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b09b-61b2-4de1-a707-884b003e1ce7 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.347595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 47/97] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:42.353692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.354479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.354950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.378840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:42.380267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:42.394620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 51/98] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:42.422378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b09b-61b2-4de1-a707-884b003e1ce7 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:42.439451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b09b-61b2-4de1-a707-884b003e1ce7 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:42.447621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:42.448456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.448739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.449012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.467781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:42.475241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:42.476517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 48/99] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:42.483233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:42.496388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82bcd-8ba9-40a8-9087-2452248366ef None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:42.506961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:42.507658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.507945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.508222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.509010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:42.509325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:42.510988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:42.526871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 52/100] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:42.532603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:42.549714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc1e7-f7c1-4271-a3b9-2d5d52d08447 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:42.559171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:42.560403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.560917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.561380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.567368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:42.569808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:42.571804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 49/101] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:42 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:42.578267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:42.592033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e01b8a-0d00-4f52-83fd-ce009a7b4718 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:42.602887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:42.603701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.603985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.604265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.611297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:42.613410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd9940-c475-4ec8-b951-9896089b4d9c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:42.615629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 53/102] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:42 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:42.621564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:42.635566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3d49-7562-4eea-ad64-986d78b9597f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:42.646804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:42.648130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.648608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.649065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/1fe56e0d3abd40ddaba691469e1780d0/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.656665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, user_id=1fe56e0d3abd40ddaba691469e1780d0, role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:42.658062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:45:42.658062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:45:42.658062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:45:42.660468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70c391-5080-443c-99b4-8b626ad7549a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:42.683085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 50/103] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:42 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/1fe56e0d3abd40ddaba691469e1780d0/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:42.978058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7d23-2562-4903-8807-1a9ea0d3408c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.978245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7d23-2562-4903-8807-1a9ea0d3408c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.978530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7d23-2562-4903-8807-1a9ea0d3408c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:42.980457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 54/104] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:42.989110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:42.989810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:42.990667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.019854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:43.021715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:43.108719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 51/105] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:43.152688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa7d23-2562-4903-8807-1a9ea0d3408c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.175441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa7d23-2562-4903-8807-1a9ea0d3408c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.180062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.180878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.181166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.181445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.202694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:43.209679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:43.211152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 55/106] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:43.217238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.233142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc9a9-1fac-452e-ba86-e42db40b9dbc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.243142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.244182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.244660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.245119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.246118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:43.246649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.249058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.268882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 52/107] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.275445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.290055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e7ed-3579-4daa-8c60-e375f9ca3b2e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.298847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.299978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.300402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.300817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.303392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.305667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.307481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 56/108] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:43.313862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.328547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428ec2-d9ea-42de-b507-218a51ce800b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.342383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.343266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.343548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.343826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] PATH_INFO: `/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.352068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] RBAC: Authorizing `identity:get_project(project_id=3f896cc6e6ba425b9dcfc59863eeda65)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.363654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ebc4c-a410-44f1-87a6-9fead703ff0f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.366020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 53/109] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65 => generated 312 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.372391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.383632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5967f-291f-48f7-bb73-fe02fb251cbf admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.394421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.395371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.395694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.395972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] PATH_INFO: `/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65/users/1fe56e0d3abd40ddaba691469e1780d0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.398165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f896cc6e6ba425b9dcfc59863eeda65, user_id=1fe56e0d3abd40ddaba691469e1780d0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.401041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc46def-feaf-4b95-afe0-ddb18e8e9708 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.421160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 57/110] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:43 2021] PUT /identity/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65/users/1fe56e0d3abd40ddaba691469e1780d0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:43.430800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee86d-721e-433f-b702-cf05f44855fb None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.431421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee86d-721e-433f-b702-cf05f44855fb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.431905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee86d-721e-433f-b702-cf05f44855fb None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.433953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 54/111] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:43.440021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9794-2069-4106-8512-6230f82c7ad5 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.440324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9794-2069-4106-8512-6230f82c7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.440580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc9794-2069-4106-8512-6230f82c7ad5 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.442544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 58/112] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:43.445249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688937-c42f-48b6-b6b2-97d97b18402d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.445784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688937-c42f-48b6-b6b2-97d97b18402d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.446243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688937-c42f-48b6-b6b2-97d97b18402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.457062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.457725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.458267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.483845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ec688937-c42f-48b6-b6b2-97d97b18402d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:43.485415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ec688937-c42f-48b6-b6b2-97d97b18402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:43.496231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:43.504429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:43.603191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 55/113] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:43.605661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b38a-e90c-4ee8-bfd2-e662f2cdb84c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.605945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b38a-e90c-4ee8-bfd2-e662f2cdb84c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.606221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b38a-e90c-4ee8-bfd2-e662f2cdb84c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.616547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 56/114] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:43 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:43.619719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.621480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.621893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.634604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 59/115] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:43.648503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:43.650008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:43.651779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.663654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea54f1c-8b9f-44fe-be12-838193296fbe None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.672910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.676311 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.676898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.677383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.678302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 57/116] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 23 11:45:43.684236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.712116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a460e-8bed-4ab7-8bff-7344b6ed82c3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.713025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:43.720151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.726747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.726747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.726747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.728655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:43.730228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 60/117] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:45:43.740896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.744793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:43.752415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:43.753812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 58/118] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:43.755052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.761182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19891-4029-48bc-800f-a40e0026dcc8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.765180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606308-ae45-4fe6-905c-bcd3f9884b60 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.770637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.771769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.772269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.772734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.774131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.776264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.778102 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 59/119] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.779164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.779267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.780044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.780327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.780603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.781387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:43.781694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.783359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.792184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591de698-27dc-4917-9060-1d1e53604372 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.795622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 61/120] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:43.801028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.803126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.804066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.804541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.805025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.806012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:43.806530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.808555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.819011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 60/121] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.820291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.820948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1150-2d09-46b0-9b07-8eee72426e86 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.831594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3dc0c-d8df-4ca8-a915-07db03b0f3af admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.834999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.835705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.835994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.836246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.836983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.837765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.838931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.839048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.839514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.839988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.841459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.843716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.845957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 61/122] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.851945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.863969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24f13-e0e6-470c-b5d1-fda2428d0362 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.869534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.870729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.871264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.872238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.874035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.876724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.878792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 62/123] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.880024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.892896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef204f27-0d9d-4157-ad5e-579e49aa2ff6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:43.898293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 62/124] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:45:43 2021] POST /identity/v3/projects => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:43.900018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:43.903018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:43.905463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.906263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.907245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.912550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:43.914989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3ac29-fb54-4319-9c29-efb18e360de4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:43.917104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 63/125] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:43.918713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc7ea-f4af-4b2c-902b-2d38ff23afcf None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:43.919177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc7ea-f4af-4b2c-902b-2d38ff23afcf None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:43.919621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efc7ea-f4af-4b2c-902b-2d38ff23afcf None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:43.927231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 64/126] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:43.929093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efc7ea-f4af-4b2c-902b-2d38ff23afcf None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.017794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eb4dc-751e-424e-ae36-78a407298c7a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.029085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.031072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.031786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.033612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.038977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.041605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2eaaee-2cfb-42ff-ac7c-9bcf5c554b53 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.044525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 63/127] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:43 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:44.048663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.050673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.051020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.054011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efc7ea-f4af-4b2c-902b-2d38ff23afcf None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.065952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.068112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.068778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.069345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/9398b24434c441718ba35a7f98df482a/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.077420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, user_id=9398b24434c441718ba35a7f98df482a, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.079679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:44.080901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:44.082491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.099175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 65/128] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:43 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/9398b24434c441718ba35a7f98df482a/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:45:44.102454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 64/129] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:44.103462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.129330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799fd16-f085-4114-8516-e7f3c515532f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.174416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.275874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.276816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.277095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.277366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/1fe56e0d3abd40ddaba691469e1780d0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.280033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, user_id=1fe56e0d3abd40ddaba691469e1780d0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.283049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.301509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 65/130] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:44 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/1fe56e0d3abd40ddaba691469e1780d0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:44.326667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86828dae-9736-4cf1-834d-788171ff42f2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.420496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.421389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.421635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.421876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.436904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:44.444295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:45:44.445938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 66/131] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:45:44.452232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.469482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e9715-0821-4096-aaa2-2d0081096afa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.476113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.476832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.477116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.477389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.478194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:44.478496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.480316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.492077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 66/132] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:44.498986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.516614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c62fc-f784-4dfc-8f5e-139c04452572 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.522808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.523800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.524080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.524352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] PATH_INFO: `/v3/users/4b8ff416cc944531b845dd352e0d4c53` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.540941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] RBAC: Authorizing `identity:get_user(user_id=4b8ff416cc944531b845dd352e0d4c53)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.543140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.545359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 67/133] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/users/4b8ff416cc944531b845dd352e0d4c53 => generated 289 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:44.552045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.563994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bfeef-fa99-4ddb-8be1-74d4e6ede880 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.570411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.571211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.571673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.571962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.581382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.583248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.594287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 67/134] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:44.599898 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.610334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb03ca-ced9-458f-ad18-d83c9f6e309e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.616202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.617178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.617482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.617754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.619038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.621245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70eb37-9fb6-47ac-a8ce-1e66d5b1f57d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.623018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 68/135] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:44.629734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:44.639230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbca94-1298-4d58-bcf1-f8ce1582b5eb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:44.644073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:44.644796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:44.645077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:44.645353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:44.646276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=4b8ff416cc944531b845dd352e0d4c53) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:44.646763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:44.649209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2572e1-7c97-46b8-8731-14938c896670 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:44.656427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 68/136] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:44 2021] GET /identity/v3/role_assignments?user.id=4b8ff416cc944531b845dd352e0d4c53&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=9c81cf138e554d748000ebc53fd507ba => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:46.294847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225815d8-09b5-46bf-a749-e8cd1f6e5270 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.295768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225815d8-09b5-46bf-a749-e8cd1f6e5270 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.295768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225815d8-09b5-46bf-a749-e8cd1f6e5270 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.297620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 69/137] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:46.308970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.309565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.309565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.333103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:46.335060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:46.345057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 69/138] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:46.390699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225815d8-09b5-46bf-a749-e8cd1f6e5270 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.409052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225815d8-09b5-46bf-a749-e8cd1f6e5270 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.415941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.416753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.417035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.417306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.439668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:46.447375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:46.448646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 70/139] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:46.455442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.464746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f691e9-3343-4b55-9849-2ffcb9337137 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.474858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.475544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.475823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.476095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.476868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:46.477172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:46.478826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:46.487769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 70/140] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:46.494062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.506298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0336135-4f9a-48e5-9c04-2146a003753e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.510887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.513398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.513756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.514039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.515306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:46.517531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:46.519177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 71/141] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:46.525189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.535714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc05a4a-2c8e-42c9-86f3-44fa0c2ac25a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.541468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.542126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.542406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.542882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.551713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:46.553421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:46.562898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 71/142] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:46.568989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.580362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d04e98-0f06-4970-a582-a9a41eb55897 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.584945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.585820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.586098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.586370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.587592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:46.589655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10f2f-20e5-4dd2-bb39-638f8baf3891 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:46.591377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 72/143] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:46.601015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.610344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8318f-3c2d-403a-9dc5-0582f061d1db admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.615143 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.616176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.616452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.616727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.617605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:46.617914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:46.619883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa526c-fd7e-4bb5-b9b8-f70cd3c77c8b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:46.626700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 72/144] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:46.875398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b687-f92d-4a80-9c1c-15f6331d97b9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.875398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b687-f92d-4a80-9c1c-15f6331d97b9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.875398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b687-f92d-4a80-9c1c-15f6331d97b9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.875398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 73/145] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:46.882647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.882928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.883198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.911709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:46.912906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:46.922687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 73/146] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:46.949504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b687-f92d-4a80-9c1c-15f6331d97b9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:46.966083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b687-f92d-4a80-9c1c-15f6331d97b9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:46.972123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:46.973334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:46.973833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:46.974310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:46.997935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:47.005610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:47.008447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 74/147] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:47.014109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.023861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190b18-bb72-4b50-82c1-07f26522f568 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.035126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.035824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.036103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.036372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.037154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:47.037456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.039121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.053191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 74/148] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.059776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.075937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8da5-7cc9-4667-9d5d-abe5b8bdd734 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.086498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.087810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.088324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.088813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.090379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.093108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.095204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 75/149] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:47.101595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.112166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096a48-399f-4aa2-819b-fb7d29275bbe admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.122777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.123535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.123819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.124095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.147369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.149087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.162935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 75/150] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:47.169025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.184889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd65afb-de33-4179-913d-f9e13e0d596a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.194205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.195428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.195922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.196393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] PATH_INFO: `/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.197825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f896cc6e6ba425b9dcfc59863eeda65)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.200129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd7823-3b70-460a-9d77-4e434c378065 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.202151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 76/151] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/projects/3f896cc6e6ba425b9dcfc59863eeda65 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.208525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.217841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448b058-b787-4b47-b92c-d94ab6309695 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.226453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.227142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.227423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.227697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.228548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=3f896cc6e6ba425b9dcfc59863eeda65, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:47.228860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.230760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28949fe-2f52-48f7-8821-847adb8a6449 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.240941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 76/152] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=3f896cc6e6ba425b9dcfc59863eeda65&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.516782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167560-0e3f-4cd9-914c-41eaa9a75b36 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.517806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167560-0e3f-4cd9-914c-41eaa9a75b36 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.518313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167560-0e3f-4cd9-914c-41eaa9a75b36 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.520561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 77/153] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:47.527489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.528005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.528108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.540901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb09e8-8d9d-4f4e-9113-86a4724e9379 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.541571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb09e8-8d9d-4f4e-9113-86a4724e9379 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.542049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb09e8-8d9d-4f4e-9113-86a4724e9379 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.544273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 78/154] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:47.553314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884c46-5753-422b-88ac-2b476161c862 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.553634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:47.554132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884c46-5753-422b-88ac-2b476161c862 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.554673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53884c46-5753-422b-88ac-2b476161c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.555208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:47.568366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 77/155] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:47.577054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-53884c46-5753-422b-88ac-2b476161c862 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:47.578575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-53884c46-5753-422b-88ac-2b476161c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:47.593006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 79/156] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:47.595105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.604497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f75d7-345e-40f0-86e4-975e02af2c3e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.609728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.610750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.611104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.611452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.631732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:47.639347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:47.640884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 78/157] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:47.647533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53884c46-5753-422b-88ac-2b476161c862 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.654978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.664216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53884c46-5753-422b-88ac-2b476161c862 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.664890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465a02-a367-44ab-8d3d-eb969d10f923 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.670434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.671363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.671652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.671923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.673242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.674451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.675375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.675475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.675948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.676400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.677250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 79/158] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:47.677510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:47.677929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.679685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.684715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.692275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 80/159] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.698548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416b82a-f266-4433-9b79-b956774b6429 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.700038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.705166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.706164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.706680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.707150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.707954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.709981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.711576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96215fc-cd0f-4e4f-a8ad-96b25f425737 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.716490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.718034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.718638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.718984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] PATH_INFO: `/v3/users/9398b24434c441718ba35a7f98df482a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.720470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] RBAC: Authorizing `identity:get_user(user_id=9398b24434c441718ba35a7f98df482a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.725538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.729748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 81/160] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/users/9398b24434c441718ba35a7f98df482a => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.731107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.740614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 80/161] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:47 2021] POST /identity/v3/users => generated 283 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:47.747524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed1f1c-7626-4717-abe4-3a5b15151641 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.752897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.753920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.754481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.755004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.766106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.768422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.779221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 82/162] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:45:47.786068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.798168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6dd49-eaf3-4a9f-abc8-19cb03aef4ad admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.803106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.804306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.804778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.805286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.806735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.809195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285d50-74e2-41b6-943c-88ed4d490cb2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.811628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 81/163] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.817851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:47.828733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918dbce-27d6-4d75-9340-a21013781e79 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:47.834152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:47.835346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.835841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.836295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.837383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=9398b24434c441718ba35a7f98df482a) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:47.837928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:47.840337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8963e96-65cd-4e12-94f6-e3d17190780c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:47.849772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 83/164] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:47 2021] GET /identity/v3/role_assignments?user.id=9398b24434c441718ba35a7f98df482a&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:47.979447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9427e-b3d9-4915-ba66-d073980fdadf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.980108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9427e-b3d9-4915-ba66-d073980fdadf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.980585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9427e-b3d9-4915-ba66-d073980fdadf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:47.983044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 82/165] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:47.989415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:47.989769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:47.989974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.019429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:48.020566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:48.034288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 84/166] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:48.059490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9427e-b3d9-4915-ba66-d073980fdadf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.074217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9427e-b3d9-4915-ba66-d073980fdadf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.079640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.080838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.081444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.081988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.095552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:48.103186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:48.104855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 83/167] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:48.111373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.121132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bdf3d-347c-4d64-8136-62c69088c589 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.127461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.128154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.129813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.129813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.129813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:48.129813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.131413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.141850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 85/168] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.149216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.160648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf3b5-8a03-4977-b788-2e7069e0fcdc admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.165708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.166780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.167066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.167335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] PATH_INFO: `/v3/users/1fe56e0d3abd40ddaba691469e1780d0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.168578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] RBAC: Authorizing `identity:get_user(user_id=1fe56e0d3abd40ddaba691469e1780d0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.170877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.172553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 84/169] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/users/1fe56e0d3abd40ddaba691469e1780d0 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.179157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.191468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f7276-757c-4172-acdc-8fd3ebb0ce64 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.197805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.198473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.198784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.199060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.208825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.210706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.221521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 86/170] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:48.228028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.240093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc08277-c0bc-4645-a924-90faaa473060 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.245216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.246098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.246354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.246648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.247822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.250353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f4dc-0e6b-4bc3-9a4b-b4689c6c2e52 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.252352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 85/171] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.258386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.268399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970428a-6650-4bc9-bac7-6dd8e9e53f29 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.274739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.275325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.275605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.275875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.276738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=1fe56e0d3abd40ddaba691469e1780d0) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:48.277047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.278930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a98d2-7134-4136-9d8f-37619aabf213 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.286294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 87/172] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/role_assignments?user.id=1fe56e0d3abd40ddaba691469e1780d0&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.300476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab0b58-2bec-429e-b687-665799e9ffff None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.300791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab0b58-2bec-429e-b687-665799e9ffff None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.301018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab0b58-2bec-429e-b687-665799e9ffff None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.302869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 86/173] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:48.309270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.309874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.310157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.329822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:48.331147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:48.340729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 88/174] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:48.367078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab0b58-2bec-429e-b687-665799e9ffff None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.387524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab0b58-2bec-429e-b687-665799e9ffff None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.394228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.394705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.394981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.395252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.410454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:48.417635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:45:48.418960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 87/175] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/roles/reader => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:48.425904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.437113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee82ad-9a71-464f-80f0-54971a0123c9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.442116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.443015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.443406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.443788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.444653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:48.445030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.446891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.458966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 89/176] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.465554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.478106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1753d8-a5bd-4c71-8aa9-9de802dfa343 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.484844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.485948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.486382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.486752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] PATH_INFO: `/v3/users/4b8ff416cc944531b845dd352e0d4c53` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.488323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b8ff416cc944531b845dd352e0d4c53)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.491111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.492967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 88/177] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/users/4b8ff416cc944531b845dd352e0d4c53 => generated 289 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.500414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.513030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd242b-b95e-4a56-9c29-3741782b349a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.519730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.521539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.522025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.522591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.525572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.528096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8281fa9-9e00-4214-9492-a3eb9ed50a73 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.530387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 90/178] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:48 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:48.537275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:48.550041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32da7-4853-4280-96fc-dbf1eb28ed63 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:48.555891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:48.556839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:48.557123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:48.557474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/4b8ff416cc944531b845dd352e0d4c53/roles/9c81cf138e554d748000ebc53fd507ba` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:48.561522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, user_id=4b8ff416cc944531b845dd352e0d4c53, role_id=9c81cf138e554d748000ebc53fd507ba)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:48.564526 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49bb7-2351-49f6-aa32-4a9d1a6ee311 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:48.582873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 89/179] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:48 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/users/4b8ff416cc944531b845dd352e0d4c53/roles/9c81cf138e554d748000ebc53fd507ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:50.586382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eed84-0715-4f43-bb75-8850b11d0809 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.586970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eed84-0715-4f43-bb75-8850b11d0809 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.586970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540eed84-0715-4f43-bb75-8850b11d0809 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.588901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 91/180] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:50.595212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.595669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.595743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.613841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:50.614995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:50.675168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 90/181] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:50.700030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eed84-0715-4f43-bb75-8850b11d0809 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.713486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540eed84-0715-4f43-bb75-8850b11d0809 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.718273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.719359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.719815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.720288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.731622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:50.739514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:50.746462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 92/182] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:50.748223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.757827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97da769-8f43-41b1-b5a8-d450859ffcf5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.762705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.763767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.764231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.764683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.766774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:50.767395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:50.769278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:50.779341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 91/183] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:50.786172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.797828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0946378-4de0-4bd0-8eb2-d85af3f0cb68 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.802776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.803927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.804383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.804828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.819512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:50.822021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a586eb-0094-4eea-ba2b-eed607355e20 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:50.824306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 93/184] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:50.832409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.842884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3a70-03b0-4c55-8593-454be76266c0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.847720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.848576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.849036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.849482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.858578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:50.860617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:50.863380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dd61-0068-458b-b566-de713b1e8358 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.863909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dd61-0068-458b-b566-de713b1e8358 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.864355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dd61-0068-458b-b566-de713b1e8358 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.866631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 94/185] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:50.873337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d3e64-ca20-4a80-a8ed-1cacffc450d2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.873622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d3e64-ca20-4a80-a8ed-1cacffc450d2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.873897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d3e64-ca20-4a80-a8ed-1cacffc450d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.875438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 92/186] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:50.881762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.891678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ed365-3da0-4833-9de5-2a0239ee2686 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.896149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.897017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.897298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.897567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.898481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-127d3e64-ca20-4a80-a8ed-1cacffc450d2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:50.898796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:50.899991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-127d3e64-ca20-4a80-a8ed-1cacffc450d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:50.900855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a038e6-cade-4c7b-abb7-8075a8b01634 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:50.902549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 93/187] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:50.903749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6467df-ff06-41a4-8b59-2cd18fcb63e3 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.904034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6467df-ff06-41a4-8b59-2cd18fcb63e3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.904345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6467df-ff06-41a4-8b59-2cd18fcb63e3 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.906111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 94/188] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:50.910498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6467df-ff06-41a4-8b59-2cd18fcb63e3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.914061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 95/189] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:50.915498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.915781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.916054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.923898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6467df-ff06-41a4-8b59-2cd18fcb63e3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.928479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.929360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.929846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.930312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.931364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=a2925bca766640dba2e1163a3cb12ade) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:50.931895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:50.933927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:50.940965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 95/190] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/role_assignments?user.id=a2925bca766640dba2e1163a3cb12ade&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:50.941095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:50.942115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.942337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:50.953154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01e39b-947f-4d8f-8124-04c5ff4a956c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.953353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 96/191] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:50.963119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:50.964264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:50.964690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:50.965103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:50.979590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:50.980836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:50.988449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:50.990622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 96/192] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:50.995023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd02927-0566-4085-9f2f-01feff52d6b2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:50.996968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.006300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.007708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.008201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.008675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.008962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09961-14b6-4078-a4db-95062320b303 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.010604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.013182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.014799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.015702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.016084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.021595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.021595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:51.021595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.021595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.022179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 97/193] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:51.023361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.030490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 97/194] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.034178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e967d-560a-419b-8df8-57668d317ff2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.036679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.039949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.040970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.041496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.041965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.042939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.045127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.047847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa80086-b73e-485d-a8ab-5b02e5ef2955 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.052935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.054081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.054545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.054966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.057131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.060070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.062897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 98/195] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:51.069256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.069751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 98/196] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:51 2021] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:51.085245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1663f-2581-4702-a15d-558261de1d95 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.090251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.090961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.091248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.091526 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.101913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.103920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.114950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 99/197] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:45:51.121644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.132674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16125a3-e096-4f93-8ae2-797c9ce7d6cf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.137452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.138453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.138892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.139204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.140670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.142879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465c135-d0d9-4729-ac9c-fc6a8c34632a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.145090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 99/198] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.151693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.162500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123f24-8c1c-4519-a214-6b886ad1db91 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.167583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.168359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.168645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.168923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.169892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=a2925bca766640dba2e1163a3cb12ade) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:51.170266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.172492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d9afb-f448-476c-8c96-5bd837922389 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.179706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 100/199] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/role_assignments?user.id=a2925bca766640dba2e1163a3cb12ade&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.200074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a15ae-7f7e-4abb-ac32-5a408be92997 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.200408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a15ae-7f7e-4abb-ac32-5a408be92997 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.200633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a15ae-7f7e-4abb-ac32-5a408be92997 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.202992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 100/200] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:51.209550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.209833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.210107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.233394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:51.234751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:51.243647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 101/201] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:51.270875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a15ae-7f7e-4abb-ac32-5a408be92997 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.285844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a15ae-7f7e-4abb-ac32-5a408be92997 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.290660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.291539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.291820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.292239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.306222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:51.314677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:45:51.316045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 101/202] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:51.323082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.334250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10162dbb-362b-43b1-99ef-5f71357d517a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.339830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.339830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.340114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.340324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.341151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:51.341464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.343894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.354107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 102/203] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.362796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.379893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6825-24e4-4b42-9ad8-a33f8b1495d2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.384831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.386131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.386652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.387096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] PATH_INFO: `/v3/users/4b8ff416cc944531b845dd352e0d4c53` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.388768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] RBAC: Authorizing `identity:get_user(user_id=4b8ff416cc944531b845dd352e0d4c53)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.392015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.394802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 102/204] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/users/4b8ff416cc944531b845dd352e0d4c53 => generated 289 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.401513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.412603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb581fa-dbb6-4e27-a7f2-9320a7537e53 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.417192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.417872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.418155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.418426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.428316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.430113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.440768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 103/205] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:51.447128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.458387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890d255-3674-4b36-8e0a-21089ef7ef9d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.465484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.466583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.467084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.467787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.470729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.473261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69334da-8b0a-4634-ac57-0e2c8d5e9297 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.476830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 103/206] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:51.484427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:51.494495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff329e-c1fe-404a-a0a8-b9f6a1a17d29 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:51.500109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:51.501282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:51.501803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:51.502290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:51.503820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817, user.id=4b8ff416cc944531b845dd352e0d4c53) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:51.504171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:51.506314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c61f-79ed-4e09-849d-225ab8f44775 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:51.514718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 104/207] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:51 2021] GET /identity/v3/role_assignments?user.id=4b8ff416cc944531b845dd352e0d4c53&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=9c81cf138e554d748000ebc53fd507ba => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.467344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e02a-9ed1-41cf-8c42-1f57aafb0e1f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.468065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e02a-9ed1-41cf-8c42-1f57aafb0e1f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.468065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05e02a-9ed1-41cf-8c42-1f57aafb0e1f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.469865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 104/208] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:53.476099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.476684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.476684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.495662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:53.496840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:53.505496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 105/209] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:53.530261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05e02a-9ed1-41cf-8c42-1f57aafb0e1f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.543290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05e02a-9ed1-41cf-8c42-1f57aafb0e1f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.548620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.549452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.549735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.550005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.563048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:53.570340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:53.571938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 105/210] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:45:53.579267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.588739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59cf5-b04d-40dd-93c7-9092a7e13e18 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.594124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.594834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.595112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.595384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.596169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:53.596475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.598092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.607612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 106/211] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.614330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.625293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e158d32-4138-42b9-85a3-7209c91edd40 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.629709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.630622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.630902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.631174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.632388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.634501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.636442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 106/212] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.642771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.653234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c18a-8834-4c66-9b62-27f2fead440e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.658608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.659491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.659770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.660046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.661254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.663346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb85a8-b84a-4617-b496-ff2f06cb826b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.665043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 107/213] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.671604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.679097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09af1-a16b-46bf-89b4-4cd323544dc1 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.679421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09af1-a16b-46bf-89b4-4cd323544dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.679636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09af1-a16b-46bf-89b4-4cd323544dc1 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.681701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 108/214] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:53.682476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120927a-1c93-4be2-a59a-76e5e0e1e5bf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.692502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.692872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.693331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.693772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.693870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.694067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.694342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/users/a2925bca766640dba2e1163a3cb12ade/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.696546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, user_id=a2925bca766640dba2e1163a3cb12ade, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.699379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.714049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:53.714226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 107/215] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:53 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/users/a2925bca766640dba2e1163a3cb12ade/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:45:53.715638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:53.787738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 109/216] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:53.814150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.824931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767250b-3dc3-464a-be9d-1b2965142bfd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.830398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.831267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.831549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.831825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.845265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:53.853155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:53.854986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 108/217] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:53.862107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.872928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e634-ffdb-4363-8925-2659c587d69c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.878063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.879135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.879679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.880154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.881132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:53.881629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.883544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.894390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 110/218] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.901915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.912164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a5fa7-d7e2-4726-9b45-4eabd276ab00 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.917128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.918283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.918734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.919194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.920704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.923199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.925525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 109/219] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.931886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.942870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859dc1-e833-4e97-9dec-495804b7353c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.948023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.949190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.949647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.950105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.952104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.954485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c84fe-285a-49c2-8bd1-cf144a76e755 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.956488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 111/220] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:53 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:53.963043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:53.974921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98af8e-a321-48db-810f-fa21b2552153 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:53.981444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:53.982616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.982837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf200f-4d56-4c96-aa57-534944f5aabd None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.983150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.983416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf200f-4d56-4c96-aa57-534944f5aabd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.983523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/users/a2925bca766640dba2e1163a3cb12ade/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.983929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf200f-4d56-4c96-aa57-534944f5aabd None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:53.985883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 112/221] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:53.986792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, user_id=a2925bca766640dba2e1163a3cb12ade, role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:53.989164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95379f5-4893-4a5d-8dab-65c8a3f0ac1b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:53.992215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:53.992433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:53.992692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.008657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 110/222] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:53 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/users/a2925bca766640dba2e1163a3cb12ade/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:45:54.014534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:54.016148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:54.024882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c778-3a27-4fff-88c7-cb701c19f311 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.025169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c778-3a27-4fff-88c7-cb701c19f311 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.025448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c778-3a27-4fff-88c7-cb701c19f311 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.027425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 111/223] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:54.034746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.035125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.035468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.054485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:54.055973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:54.099980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 113/224] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:54.124320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.132684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 112/225] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:54.134342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecea80a-2cd0-4521-8198-a2f52c00e6d6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.143105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.144457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.144939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.145430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.159292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:54.159874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.167308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:54.169252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 114/226] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:54.174693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2e8a1-41e9-4b42-b144-1834dacef7ba None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.177089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.179702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.180535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.180811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.181076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.182487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.184377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.186948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 113/227] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:54.191182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7d237-c4e3-4f70-89e5-892cf1d25b16 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.193153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.197209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.198255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.198666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.199037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.199960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:54.200392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.202391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.205520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21bb28-213c-434b-9e67-175f5be142a1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.211515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.212514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.212993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.213410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.213741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 115/228] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:54.214652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.217871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.220540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.232015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526dd73-3aec-4e04-9794-0efcfd96c9c9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.239032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.240044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.240701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.241025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] PATH_INFO: `/v3/users/b1eea75c307f40cbb3273836f70b0471` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.243265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 114/229] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:54 2021] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:54.263629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] RBAC: Authorizing `identity:get_user(user_id=b1eea75c307f40cbb3273836f70b0471)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.265775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.268008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 116/230] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/users/b1eea75c307f40cbb3273836f70b0471 => generated 297 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:54.275094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.288460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d651-2b95-42dd-9217-a5d9b4cf24e8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.293531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.294244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.294539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.294986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.304851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.307176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.319052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 115/231] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:54.325437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.336137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0992eb-65d4-4eb8-94d2-5c820a7aec94 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.340693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.341760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.342308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.342984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.344062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.347712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bec4f0-c697-443a-b694-1d2d81b45249 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.349903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 117/232] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:54.356525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:54.366903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df66254-510e-4e3e-8c6c-5b9a52a09a11 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:54.371752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:54.372477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:54.372770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:54.373155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:54.374177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=b1eea75c307f40cbb3273836f70b0471) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:54.374677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:54.377068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3acc0-1dfe-4a3e-b2a3-7684961e8ec1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:54.384967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 116/233] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:54 2021] GET /identity/v3/role_assignments?user.id=b1eea75c307f40cbb3273836f70b0471&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:56.713337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8377e16-1755-4902-9899-40a504db7d95 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.713992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8377e16-1755-4902-9899-40a504db7d95 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.713992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8377e16-1755-4902-9899-40a504db7d95 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.715803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 118/234] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:56.723996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05407-9028-44e0-8035-9e7e4bb0ffdc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.724609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05407-9028-44e0-8035-9e7e4bb0ffdc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.724883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05407-9028-44e0-8035-9e7e4bb0ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.748128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6ee05407-9028-44e0-8035-9e7e4bb0ffdc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:56.750266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6ee05407-9028-44e0-8035-9e7e4bb0ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:56.762614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 117/235] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:56.800134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8377e16-1755-4902-9899-40a504db7d95 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:56.820273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8377e16-1755-4902-9899-40a504db7d95 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:56.826970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:56.827905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.828188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.828762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.842857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:56.849818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:45:56.851369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 119/236] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:45:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:56.855245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d308-cbf4-4652-82b0-afa7bcc6c695 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.855530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d308-cbf4-4652-82b0-afa7bcc6c695 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.855801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d308-cbf4-4652-82b0-afa7bcc6c695 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.857682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 118/237] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:56.858591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:56.865146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.865735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.866004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.872764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7cd97-d391-48da-ba0e-a49064ee424d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:56.886910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:56.887595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.887865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.888129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.889045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:56.889045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:56.891025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:56.901200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:56.902380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:56.910060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 120/238] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:56.916506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 119/239] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:56.923832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:56.934465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b592c-5102-4f8d-8cd3-70864a69a9e5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:56.942550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:56.943442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.943715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.943981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.945240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:56.947523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:56.949187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 121/240] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:56 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:56.956340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:56.966297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a1a26-1cf4-467e-a826-743b0dca72a9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:56.975167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:56.975843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:56.976138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:56.976406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:56.985200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:56.987158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:56.995014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.004791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 120/241] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:57.006107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9f1ed-6098-4f95-b22f-33742535f312 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.011607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.014445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.022443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7ea90-27ca-4b28-a24f-61dbc1f9a905 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.023446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.023795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.024074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.027965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.029120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.030300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.030822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.032280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.034594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.036550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 121/242] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:57.043185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.047966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:57.054116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abee4f4-99ca-4cdd-98c8-4fe33f04816a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.058764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.059631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.060105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.060817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.063100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=a2925bca766640dba2e1163a3cb12ade) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:57.063658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.065477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:45:57.065904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.066980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 122/243] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:45:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:57.073489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 122/244] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/role_assignments?user.id=a2925bca766640dba2e1163a3cb12ade&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:57.078786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.091044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fada6-d82e-47e7-b19a-439e72097ff6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.096598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.097382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.097660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.097941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.098815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:57.099115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.100903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.112646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 123/245] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.119022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.129942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701c459-54e4-42d0-8472-2a373a083882 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.134985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.135932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.136209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.136484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] PATH_INFO: `/v3/users/a2925bca766640dba2e1163a3cb12ade` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.137783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] RBAC: Authorizing `identity:get_user(user_id=a2925bca766640dba2e1163a3cb12ade)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.140328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.142117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 123/246] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/users/a2925bca766640dba2e1163a3cb12ade => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.148829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.159573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7e1c-12f9-4ad2-8264-dfe603b185d3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.164511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.165230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.165508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.165825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.175298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.177465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.188058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 124/247] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:57.194759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.205979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6b5b-13c7-49d5-890d-250e5e96aa6b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.210943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.211919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.212242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.212572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.213973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.216683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe78b70-226c-4b30-be42-6d06c532bccd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.218556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 124/248] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.226151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.229993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc46c-2a1c-4f3b-a3d7-e2d795be1746 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.230279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc46c-2a1c-4f3b-a3d7-e2d795be1746 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.230591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcc46c-2a1c-4f3b-a3d7-e2d795be1746 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.232478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 125/249] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:57.236082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3d53-0c27-45c3-ac34-44b7aa9f757b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.241266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.242016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.242329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.242652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.243711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=a2925bca766640dba2e1163a3cb12ade) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:57.244025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.246238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.248825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86090f2f-a3aa-441c-b62f-0ba0688740d3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.249150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86090f2f-a3aa-441c-b62f-0ba0688740d3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.249510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86090f2f-a3aa-441c-b62f-0ba0688740d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.253916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 125/250] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/role_assignments?user.id=a2925bca766640dba2e1163a3cb12ade&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.291825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-86090f2f-a3aa-441c-b62f-0ba0688740d3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:57.293075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-86090f2f-a3aa-441c-b62f-0ba0688740d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:57.312265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 126/251] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:45:57.360333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.372808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff074-b63c-4b82-b23e-3948e2d18339 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.373154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff074-b63c-4b82-b23e-3948e2d18339 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.373339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff074-b63c-4b82-b23e-3948e2d18339 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.373836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdd3eb-d0fa-4e09-8a0e-d97f23a3b07b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.375378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 127/252] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:45:57.379344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.380356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.380733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.381090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.381646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.381929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.382204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.396045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:57.403479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:45:57.406182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 126/253] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:57.411577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.423157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:57.423758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c11c0-d53e-438a-bec8-acdc07acc8e3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.424385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:57.428640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.429490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.429819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.430155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.431115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:57.431575 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.433438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.442398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 128/254] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 23 11:45:57.445586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 127/255] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:57.452097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.463946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d00b-ccfa-4234-963e-7e95ec35d526 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.469488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.470538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.470975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.471432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] PATH_INFO: `/v3/users/b1eea75c307f40cbb3273836f70b0471` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.472998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] RBAC: Authorizing `identity:get_user(user_id=b1eea75c307f40cbb3273836f70b0471)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.475591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.476229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.478687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 129/256] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/users/b1eea75c307f40cbb3273836f70b0471 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.489707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.497212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abe20e-2c03-4650-b91f-f5ee3cc32034 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.501012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99585-d612-40cc-aabf-424665b6aa66 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.504324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.505333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.505696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.505819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.506193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.506627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.506972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.507166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.507771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.508386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.509607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.510419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.511740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 128/257] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:45:57.512144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 130/258] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.518333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.523366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.529871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2425e8-f97c-4812-9d56-d013d93cebe5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.534003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e6121-3d9a-4346-9f85-2a5b9be72bcc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.534923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.535596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.535979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.536252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.536989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.538591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.539468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.539748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.539902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6290c-9fa2-4fd0-96e0-7acd3c102249 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.540064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/users/b1eea75c307f40cbb3273836f70b0471/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.542028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, user_id=b1eea75c307f40cbb3273836f70b0471, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.545104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc700a-24d4-45f8-8506-0a78744bc0d9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.562739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 131/259] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:45:57 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/users/b1eea75c307f40cbb3273836f70b0471/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:45:57.565136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 129/260] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:45:57 2021] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:45:57.761032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9fb9-2560-4c0f-8b30-992379afc13c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.761947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9fb9-2560-4c0f-8b30-992379afc13c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.761947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9fb9-2560-4c0f-8b30-992379afc13c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.763894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 132/261] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:45:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:45:57.771365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.771907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.771907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.800819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:45:57.802607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:45:57.881077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 130/262] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:45:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:45:57.906617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9fb9-2560-4c0f-8b30-992379afc13c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.919902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9fb9-2560-4c0f-8b30-992379afc13c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.925074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.925887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.926168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.926439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.938884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:45:57.946044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:45:57.947503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 133/263] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:45:57.954299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:57.965080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3ba62-2126-4ab3-82a3-a9ffb68fcf73 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:57.971745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:57.972473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:57.972764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:57.973059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:57.973955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:57.974284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:57.976031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:57.985927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 131/264] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:57.992524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:58.004374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170825f-aa29-44da-9520-65d516f77a0f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:58.009475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:58.010740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:58.011333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:58.011895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] PATH_INFO: `/v3/users/341d62b498444ad0a447c5d7d718c627` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:58.031931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] RBAC: Authorizing `identity:get_user(user_id=341d62b498444ad0a447c5d7d718c627)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:58.034747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:58.036788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 134/265] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:45:57 2021] GET /identity/v3/users/341d62b498444ad0a447c5d7d718c627 => generated 297 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:58.043394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:58.053925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09fcf2-e63a-47a4-acb6-a9c059f4013d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:58.058676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:58.059333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:58.059651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:58.059948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:58.069162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:58.071079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:58.086606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 132/266] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:45:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:45:58.096004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:58.125640 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ecb47-cdc9-4c99-bb38-7e4420548242 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:58.192818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:58.193828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:58.194271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:58.194605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:58.199256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:58.201486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038223a1-f059-4e5b-b8ca-9865a95c0ad9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:58.203720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 135/267] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:45:58 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:45:58.215880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:45:58.237098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4232223-74d6-4571-9701-064d3f1c973c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:45:58.251324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:45:58.252148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:45:58.252457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:45:58.252749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:45:58.253638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=341d62b498444ad0a447c5d7d718c627) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:45:58.253947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:45:58.255847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a504cf1-0aa2-45aa-bf9c-c859a5600dbd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:45:58.272850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 133/268] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:45:58 2021] GET /identity/v3/role_assignments?user.id=341d62b498444ad0a447c5d7d718c627&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=9c81cf138e554d748000ebc53fd507ba => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.059870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963224-a90c-4c7e-91c9-213e7e0127e9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.060453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963224-a90c-4c7e-91c9-213e7e0127e9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.060530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8963224-a90c-4c7e-91c9-213e7e0127e9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.062638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 136/269] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:00.072569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.073033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.073119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.091410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:00.093132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:00.101545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 134/270] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:00.127145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963224-a90c-4c7e-91c9-213e7e0127e9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.140676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8963224-a90c-4c7e-91c9-213e7e0127e9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.145785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.146629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.146911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.147182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.158934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:00.166336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:00.167826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 137/271] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:00.174195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.184047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bda5f-fe18-4ae1-8275-7075ce9039ad None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.190310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.191358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.191987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.192611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.193627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:00.194129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.196036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.206569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 135/272] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.218544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.223205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaf755-7cd2-487e-9c6f-2721c493ff58 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.227858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.228833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.229182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.229523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] PATH_INFO: `/v3/users/b1eea75c307f40cbb3273836f70b0471` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.230843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] RBAC: Authorizing `identity:get_user(user_id=b1eea75c307f40cbb3273836f70b0471)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.233091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.235127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 138/273] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/users/b1eea75c307f40cbb3273836f70b0471 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.241609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.252361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004202e9-90f1-4130-8a46-46d5cb9227e8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.257204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.257890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.258193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.258488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.268029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.269999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.280264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 136/274] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:00.286596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.296705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0145b-06f4-43be-aff1-4639db37ad6d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.301529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.302451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.302784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.303088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.304344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.306562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555d72e-1ed0-471a-9148-a089c194fd4f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.308323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 139/275] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:00.315215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.324906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20e4c4-ac6f-4ad1-8df2-ea9603b35534 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.329892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.330619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.331006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.331320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.332255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=b1eea75c307f40cbb3273836f70b0471) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:00.332605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.334607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835fc9-fe2a-4ba1-af7b-ae27f651bcc3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.342026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 137/276] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/role_assignments?user.id=b1eea75c307f40cbb3273836f70b0471&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.363772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813507-59d5-49ef-8e87-e14e9e24fc91 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.364246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813507-59d5-49ef-8e87-e14e9e24fc91 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.364631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813507-59d5-49ef-8e87-e14e9e24fc91 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.365109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dfd5-ec6f-4748-b176-dd3173f3b4cc None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.365707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dfd5-ec6f-4748-b176-dd3173f3b4cc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.365978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70dfd5-ec6f-4748-b176-dd3173f3b4cc None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.366779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 140/277] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:00.368393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 138/278] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:00.373724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.374083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.374313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.374874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.375167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.375480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.394579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:00.395368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:00.395892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:00.396530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:00.404282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 141/279] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:00.410847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 139/280] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:00.430301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.430560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.440930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309d2da-191e-431e-bd3c-ac3d817ee39b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.441147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068ac88-bce3-4148-ac19-0db09eed948a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.446132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.446382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.447048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.447164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.447349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.447442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.447648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.447740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.449014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.451069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.453038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 140/281] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.459480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.462587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:00.469990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed6fa8-bcb7-4a01-b0d3-a570c0e4905d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.470199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:00.471997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 142/282] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:00.476467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.477155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.477584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.477908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.478682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.478812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.480678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.490162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d946d7-808f-4287-a757-f8376c67ec24 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.495497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.496283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.496577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.496943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.498066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:00.498439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.500383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.511957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 143/284] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:00.512380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 141/284] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:00 2021] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:00.517757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.529420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6f31-ad2b-4f86-89d8-170d1f7ec1ce admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.534558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.535477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.535760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.536034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] PATH_INFO: `/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.557030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e4f1b2b05a14c25865acc7d2cdf6ee1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.559548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3fe14-4085-4f09-80f1-04d0b7c09cc1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.562123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 144/285] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1 => generated 293 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:00.569640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.585359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5c635-a3a6-4cb0-a147-11f1e0e9a08e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.590576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.591541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.591956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.592454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.593638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, user.id=9e4f1b2b05a14c25865acc7d2cdf6ee1, scope.system=all) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:00.594082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:00.596477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5d01d-2437-45fa-b2f9-980ca1465f73 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:00.606008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 142/286] 10.222.0.65 () {56 vars in 1329 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/role_assignments?user.id=9e4f1b2b05a14c25865acc7d2cdf6ee1&scope.system=all&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:00.862625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a29c4-f99c-4976-9867-e13a90d98750 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.862966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a29c4-f99c-4976-9867-e13a90d98750 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.863271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a29c4-f99c-4976-9867-e13a90d98750 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.866224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 145/287] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:00.875878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.876557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.876976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.902447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:00.904135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:00.915425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 143/288] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:00.939460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a29c4-f99c-4976-9867-e13a90d98750 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:00.955187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a29c4-f99c-4976-9867-e13a90d98750 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:00.960238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:00.961066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:00.961337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:00.961625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:00.975710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:00.983269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:46:00.984595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 146/289] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:00.991573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:01.001399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55c6a-ae10-4a04-8ed4-116808574065 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:01.006239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:01.007029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:01.007313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:01.007674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:01.008492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:01.008835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:01.010845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:01.022362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 144/290] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:01.028801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:01.040036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8419abd-2243-4026-bc27-e3c9134b5145 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:01.045006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:01.046044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:01.046388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:01.046728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] PATH_INFO: `/v3/users/341d62b498444ad0a447c5d7d718c627` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:01.048148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] RBAC: Authorizing `identity:get_user(user_id=341d62b498444ad0a447c5d7d718c627)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:01.050669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:01.052584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 147/291] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:01 2021] GET /identity/v3/users/341d62b498444ad0a447c5d7d718c627 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:01.058574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:01.069746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9050-6dc4-4e1d-9760-c14744a689e5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:01.074456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:01.075490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:01.075916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:01.076214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:01.077515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:01.079723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174338d0-ea9a-428a-838f-318dc65e6b47 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:01.081669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 145/292] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:01 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:01.088222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:01.099879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936e7d3-1bd7-4ca3-ad6c-1e55df32a007 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:01.104821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:01.105968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:01.106338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:01.106741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/users/341d62b498444ad0a447c5d7d718c627/roles/9c81cf138e554d748000ebc53fd507ba` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:01.109106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, user_id=341d62b498444ad0a447c5d7d718c627, role_id=9c81cf138e554d748000ebc53fd507ba)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:01.112231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf23ca-2499-4931-bfe7-17f706e64550 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:01.128156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 148/293] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:01 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/users/341d62b498444ad0a447c5d7d718c627/roles/9c81cf138e554d748000ebc53fd507ba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:03.053745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238294-5c91-4f1b-b5c7-a3a050833eeb None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.054437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238294-5c91-4f1b-b5c7-a3a050833eeb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.054437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b238294-5c91-4f1b-b5c7-a3a050833eeb None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.056374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 146/294] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:03.062751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.063392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.063392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.081749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:03.083014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:03.106216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9a2c-ea0c-48cc-961a-5e41e131d5b5 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.106550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9a2c-ea0c-48cc-961a-5e41e131d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.106818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b9a2c-ea0c-48cc-961a-5e41e131d5b5 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.109360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 147/295] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:03.115766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60d87-806c-4be7-98aa-a6fb7186da35 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.116271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60d87-806c-4be7-98aa-a6fb7186da35 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.116721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60d87-806c-4be7-98aa-a6fb7186da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.135681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-53f60d87-806c-4be7-98aa-a6fb7186da35 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:03.137202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-53f60d87-806c-4be7-98aa-a6fb7186da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:03.147756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 149/296] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:03.171805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.180727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa851b6-f8d0-4007-ba8b-8b06c6f642d4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.185542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.186400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.186765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.187035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.197761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:03.205109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:03.205914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 148/297] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:03.210929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 150/298] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:03.212643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cda3-f332-43a7-ab0d-40626fdec9ca None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.213000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.213247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cda3-f332-43a7-ab0d-40626fdec9ca None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.213743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217cda3-f332-43a7-ab0d-40626fdec9ca None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.215681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 149/299] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:03.222076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.222561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.222973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.223740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916191a-20cd-4be1-b614-fedeb811e04b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.228159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.228888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.229234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.229576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.230406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:03.230803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.233047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.242117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 151/300] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:03.244210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:03.245414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:03.245665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.254004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 150/301] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:03.254686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.256523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb839d-1ca6-462b-8406-6e99252cb32c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.262052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.262892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.263174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.263624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.272319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d90ce-f6e8-4c2c-b006-103b2512391f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.280209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.280749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.281033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.281304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] PATH_INFO: `/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.282753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e4f1b2b05a14c25865acc7d2cdf6ee1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.283723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:03.285285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.287292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 151/302] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1 => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.288202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.291441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:46:03.298697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 152/303] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:03.299728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.300464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475e61-811e-4f32-8a89-ae9056353c59 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.305082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.305827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.306082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.306353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.307569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.309247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.311157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 152/304] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.311871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.312363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6b12a-96ea-492e-aa8e-8a1ebf1eea95 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.321566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275a6b7-39d5-406c-92c2-9d8a74b9b2d0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.321863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.322995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.323465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.323908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] PATH_INFO: `/v3/system/users/9e4f1b2b05a14c25865acc7d2cdf6ee1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.325614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9e4f1b2b05a14c25865acc7d2cdf6ee1, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.326331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.326983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.327229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.327435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.328203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:03.328512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.328636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:03.328636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:03.328636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:03.329736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.330104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.345784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 153/305] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.345784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.346035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 153/306] 10.222.0.65 () {58 vars in 1355 bytes} [Thu Dec 23 11:46:03 2021] PUT /identity/v3/system/users/9e4f1b2b05a14c25865acc7d2cdf6ee1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:03.352967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa230266-4b4a-4939-b854-6d4e351b48ad admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.356402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.358061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.358837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.359184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.359463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] PATH_INFO: `/v3/groups` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.360474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.361329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:03.361329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:03.361329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:03.362547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.381222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5731c8-96e4-4f44-bf00-9301adb4149c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.381467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 154/307] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 11:46:03 2021] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:03.394195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.395539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.395989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.396445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] PATH_INFO: `/v3/users/c73cc78180ee401194476399df35e678` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.414980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] RBAC: Authorizing `identity:get_user(user_id=c73cc78180ee401194476399df35e678)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.417699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e2773-505e-4c27-8929-c5c928adf67d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.421020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 154/308] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/users/c73cc78180ee401194476399df35e678 => generated 293 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.431697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.446634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591fc8-bc78-471a-827f-addc0290eead admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.452627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.453703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.454230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.454769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.456018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, user.id=c73cc78180ee401194476399df35e678, scope.system=all) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:03.456531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.458827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8cec-b666-47b6-90f2-bf0b38e6e821 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.465792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 155/309] 10.222.0.65 () {56 vars in 1329 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/role_assignments?user.id=c73cc78180ee401194476399df35e678&scope.system=all&role.id=9c81cf138e554d748000ebc53fd507ba => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.563424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe46e-c6f0-4a98-96b3-686ca6983b54 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.564176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe46e-c6f0-4a98-96b3-686ca6983b54 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.564664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe46e-c6f0-4a98-96b3-686ca6983b54 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.566979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 155/310] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:03.573872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.574193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.574422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.594947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:03.596570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:03.605089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 156/311] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:03.631100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe46e-c6f0-4a98-96b3-686ca6983b54 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.645358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe46e-c6f0-4a98-96b3-686ca6983b54 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.650157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.651014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.651387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.651662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.664464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:03.671945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:46:03.673612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 156/312] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:03.680136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.693181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df51a27-360e-4aa8-934d-6bf7ba67e0f6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.698361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.699417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.699848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.700264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.701387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:03.701923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.703852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.714192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 157/313] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.720702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.732548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f96a-25d9-4fcc-88f5-0ad0aa2d6a5d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.737896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.739064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.739487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.739901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] PATH_INFO: `/v3/users/341d62b498444ad0a447c5d7d718c627` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.741672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=341d62b498444ad0a447c5d7d718c627)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.744050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.745976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 157/314] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/users/341d62b498444ad0a447c5d7d718c627 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.752670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.763427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b301102-0b68-4381-8b4e-012a1fccfea5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.768695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.769598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.770026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.770473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.779777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.782005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.792390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 158/315] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:03.798823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.808997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb9237-af08-4467-9140-7f4375c4b5a6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.814168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.815312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.815834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.816289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.817708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.820109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1f51b-d59d-476c-94ba-d94e67650aa2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.822031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 158/316] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:03.829548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:03.840214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf1ad6-9cc4-4ed0-928d-a483bef2c564 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:03.845312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:03.846240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:03.846694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:03.847151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:03.848184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, scope.project.id=c70c06036b134d169ca21eee42fa0624, user.id=341d62b498444ad0a447c5d7d718c627) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:03.848678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:03.850779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81185ab-6d9f-421d-b60f-99aae7a83f8b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:03.857709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 159/317] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:03 2021] GET /identity/v3/role_assignments?user.id=341d62b498444ad0a447c5d7d718c627&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=9c81cf138e554d748000ebc53fd507ba => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:05.766192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c744-7a3a-4402-a359-bd403ae49bb9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.766731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c744-7a3a-4402-a359-bd403ae49bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.766731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34c744-7a3a-4402-a359-bd403ae49bb9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.768412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 159/318] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:05.774733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a419ea-5cab-43df-b9b7-49667e9b7aea None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.775173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a419ea-5cab-43df-b9b7-49667e9b7aea None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.775350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a419ea-5cab-43df-b9b7-49667e9b7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.795582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-53a419ea-5cab-43df-b9b7-49667e9b7aea None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:05.797047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-53a419ea-5cab-43df-b9b7-49667e9b7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:05.804430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 160/319] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:05.829208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34c744-7a3a-4402-a359-bd403ae49bb9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.832788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527398a9-fb62-4866-8753-55fa67de802d None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.833107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527398a9-fb62-4866-8753-55fa67de802d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.833296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527398a9-fb62-4866-8753-55fa67de802d None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.835217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 161/320] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:05.841019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.841304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.841481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34c744-7a3a-4402-a359-bd403ae49bb9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.841634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.845821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.846639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.846915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.847182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.858604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:05.859532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:05.860781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:05.865933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-d2b164d3-c8cd-48a8-b7cd-2ecd686abd7d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:05.867167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 160/321] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:05.868966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 162/322] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:05.869803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefce4a-9df9-4ef1-9584-07a06ba92e4a None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.870090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefce4a-9df9-4ef1-9584-07a06ba92e4a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.870370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefce4a-9df9-4ef1-9584-07a06ba92e4a None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.872189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 161/323] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:05.873780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.878153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.878646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.878747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.883902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff9a59-55eb-4100-9fd4-f528a57755d3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.889279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.889928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.890208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.890477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.891302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:05.891606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:05.893428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:05.896935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:05.898120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:05.902150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 163/324] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:05.907200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.909475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 162/325] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:05.910283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.912829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360fed3-dd84-4ed6-bb5d-897f8e36b128 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.917135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.917936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.918218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.918488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.919841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:05.920690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a961fe-6146-48aa-b3f4-6f11d9ed493a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.921536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:05.926629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 164/326] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:05.928887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.929000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.929881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.930164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.930436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] PATH_INFO: `/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.931722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] RBAC: Authorizing `identity:get_user(user_id=9e4f1b2b05a14c25865acc7d2cdf6ee1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:05.933837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:05.936080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 163/327] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/users/9e4f1b2b05a14c25865acc7d2cdf6ee1 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:05.936705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.938561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93182c3f-10a7-4826-bf7b-b19dea6abced admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.942804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.943450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.943730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.944001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] PATH_INFO: `/v3/groups` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.944695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:05.946569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90df1-efe8-495e-9421-580a092339cd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.946659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:05.951007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.952098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.952449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.952899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.960548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 165/328] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Dec 23 11:46:05 2021] POST /identity/v3/groups => generated 226 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:05.963483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.964397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:05.972266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:46:05.973775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 164/329] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:05.974011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473222f7-49b7-4730-b4e6-99440e1ae723 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.978644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.979709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.979994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.980087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:05.980263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.981132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] RBAC: Adding query filter params (role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, user.id=9e4f1b2b05a14c25865acc7d2cdf6ee1, scope.system=all) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:05.981438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:05.983642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:05.991783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2cf24-770c-44b9-a3fd-3eadb02714f3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:05.996434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:05.997125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:05.997408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:05.997756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:05.998770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:05.999084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:06.000723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:06.002891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 166/330] 10.222.0.65 () {56 vars in 1329 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/role_assignments?user.id=9e4f1b2b05a14c25865acc7d2cdf6ee1&scope.system=all&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 510 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:06.020265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 165/331] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:05 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:06.021274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:06.032927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b74957-1741-4daa-93e8-3d3f00628196 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:06.038314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:06.039394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:06.039710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:06.040022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] PATH_INFO: `/v3/users/c73cc78180ee401194476399df35e678` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:06.041517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=c73cc78180ee401194476399df35e678)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:06.043994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4464-2949-40cb-8a8a-fbc10e9b99c7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:06.051217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 167/332] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:06 2021] GET /identity/v3/users/c73cc78180ee401194476399df35e678 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:06.052968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:06.065664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6106c-739f-49dc-a571-49596475dbf2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:06.070776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:06.071800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:06.072153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:06.072499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] PATH_INFO: `/v3/system/users/c73cc78180ee401194476399df35e678/roles/9c81cf138e554d748000ebc53fd507ba` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:06.074357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c73cc78180ee401194476399df35e678, role_id=9c81cf138e554d748000ebc53fd507ba)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:06.076595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb12d2-532a-486a-a9fb-ebbaf01421ff admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:06.090573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 166/333] 10.222.0.65 () {58 vars in 1355 bytes} [Thu Dec 23 11:46:06 2021] PUT /identity/v3/system/users/c73cc78180ee401194476399df35e678/roles/9c81cf138e554d748000ebc53fd507ba => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:08.607839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc92f9-56e1-4f3f-9f50-1d949f2218ed None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.608944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc92f9-56e1-4f3f-9f50-1d949f2218ed None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.609496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc92f9-56e1-4f3f-9f50-1d949f2218ed None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.611529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 168/334] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:08.617970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.618535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.618535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.647676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:08.648886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:08.657161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 167/335] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:08.701537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc92f9-56e1-4f3f-9f50-1d949f2218ed None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.720289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc92f9-56e1-4f3f-9f50-1d949f2218ed None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:08.726902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:08.728059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.728537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.729005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.741834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:08.750209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:08.752162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 169/336] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:08.757970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.771649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1465d-024b-4406-bb42-ccd98c7961ee None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:08.783147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:08.783837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.784118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.784387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.785162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:08.785470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:08.787098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:08.799531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 168/337] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:08.805469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.816527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac42f-4a54-4e32-8224-759b7aa96b18 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:08.830717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:08.832019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.832576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.833288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.843075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:08.845252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd4c9-4900-4228-a0b2-a7dd8899fdf6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:08.861376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 170/338] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:08.871092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.887862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52942c16-0e49-4d6b-a057-6cafde9c9b51 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:08.899899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:08.900785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.901065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.901337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.907387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:08.911574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:08.913723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 169/339] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:08.918608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae63e-232b-41c8-92df-b5145fd156cf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.919178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae63e-232b-41c8-92df-b5145fd156cf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.919786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae63e-232b-41c8-92df-b5145fd156cf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.919896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.922390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 171/340] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:08.928849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.929126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.929398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.934837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66c45c-9166-480b-9f6b-bbc529003a5c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:08.949811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:08.950807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:08.951111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:08.951385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:08.962265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:08.963481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:08.964918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:08.965942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:08.965942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:08.965942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:08.967319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:08.974390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 170/341] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:08.975375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:08.988331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 172/342] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:08.989260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fba22-c9bf-4f36-a086-34bf97770d68 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.004204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.004882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.005157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.005433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.006296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.006631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.008495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.017949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 171/343] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:08 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.035004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.048220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ed1c-4141-436d-8688-64fff576a6fc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.058454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.059326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.059604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.059877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.091461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:09.099039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:09.100670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 173/344] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:09.107445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.125188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc7a99-4e93-4c95-9ab4-e606d36b66ce admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.139357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.140058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.140338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.140612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.141394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.141696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.143332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.157854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 172/345] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.164271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.178186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ba8d6-8b81-47e3-8a46-217fd93a8a04 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.186684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.187365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.187649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.187929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.203562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.205602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.221601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 174/346] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:09.228101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.244171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cecf1c-90ae-464e-a8fe-5d900a1a44e8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.254042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.254941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.255219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.255491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.259299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.261363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.263581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 173/347] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.270221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.284242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8add694-0ac2-46bf-b122-7e6a620ee7bc admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.293926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.294884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.295172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.295445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.299543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.300623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:09.300623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:09.300623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:09.301880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19fe10-ff4d-4d10-8b28-ad73da898422 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.303900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 175/348] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.310705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.323743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88bf5-b68f-4adb-8176-d6ef8d01b055 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.335352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.336043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.336324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.336649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.337568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.337882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.339793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61de6-df29-4bb3-9d8f-f9a753f73350 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.346585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 174/349] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.452317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda494e7-68d6-4024-a5b8-5c4d1019b78a None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.452619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda494e7-68d6-4024-a5b8-5c4d1019b78a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.452784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda494e7-68d6-4024-a5b8-5c4d1019b78a None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.454867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 176/350] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:09.460976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.461280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.461530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.484967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:09.486194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:09.497589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 175/351] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:09.534200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda494e7-68d6-4024-a5b8-5c4d1019b78a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.551313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda494e7-68d6-4024-a5b8-5c4d1019b78a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.555932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.556772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.557055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.557329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.573491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:09.581017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 23 11:46:09.582700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 177/352] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:09.588698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.598404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68686106-f39e-4f43-9dae-9b3db0cc8112 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.607300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.607987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.608291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.608625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.609455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.609792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.611592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.627531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 176/353] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.633852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.647954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b085df-1780-4bc9-b4d4-cdba63b49613 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.659370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.660864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.661382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.661816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] PATH_INFO: `/v3/users/c73cc78180ee401194476399df35e678` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.663380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] RBAC: Authorizing `identity:get_user(user_id=c73cc78180ee401194476399df35e678)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.665876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c811e2-2c84-471c-9500-d7609df2fa8a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.668204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 178/354] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/users/c73cc78180ee401194476399df35e678 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.674471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.685297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7075448-edd8-4c9f-8b29-b2bf2e055263 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.694924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.695842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.696291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.696729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.697732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] RBAC: Adding query filter params (role.id=9c81cf138e554d748000ebc53fd507ba, user.id=c73cc78180ee401194476399df35e678, scope.system=all) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.698186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.700296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7e109-bfd8-4b84-a196-404f24ac436f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.724421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 177/355] 10.222.0.65 () {56 vars in 1329 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/role_assignments?user.id=c73cc78180ee401194476399df35e678&scope.system=all&role.id=9c81cf138e554d748000ebc53fd507ba => generated 510 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.792185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4ea3-e044-479d-87f6-fd416138fa45 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.792527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4ea3-e044-479d-87f6-fd416138fa45 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.792739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a4ea3-e044-479d-87f6-fd416138fa45 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.795613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 179/356] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:09.801991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.802679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.803178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.828860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:09.830420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:09.840072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 178/357] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:09.878445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a4ea3-e044-479d-87f6-fd416138fa45 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.895821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a4ea3-e044-479d-87f6-fd416138fa45 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.902875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.903761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.904073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.905027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.921474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:09.929059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:09.933570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 180/358] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:09.938457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:09.951982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9aa36-8ef2-44c7-a775-f73900a7c741 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:09.962875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:09.963944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:09.964434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:09.964905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:09.965896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:09.966474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:09.968360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:09.983378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 179/359] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:09.989670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:10.005492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f0a1-142c-4980-ae29-5476e0eb017d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:10.011858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:10.012576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.012851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.013149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.028661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:10.031375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:10.043605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 181/360] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:10.050022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:10.063990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb8207-e43a-47f4-b772-0c7eea787b9c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:10.070822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:10.071949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.072427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.072892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.074322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:10.076918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:10.078894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 180/361] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:10 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:10.085056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:10.099850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97a377-95e9-4173-8455-4843937dc0ee admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:10.110820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:10.111695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.111980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.112248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.119279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:10.121217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94dda-248b-4450-a518-320979257373 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:10.123272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 182/362] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:10 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:10.129601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:10.143034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f391639-ca6e-4d15-828d-051496de6afd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:10.153843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:10.154528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.154811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.155082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.155940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=c70c06036b134d169ca21eee42fa0624) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:10.156249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:10.158109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371ae11-4862-40cf-bd00-3b9cb3c8dd59 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:10.166995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 181/363] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:10 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:10.936009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e7cd-117e-420b-8616-052bab9070d1 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.937030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e7cd-117e-420b-8616-052bab9070d1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.937541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e7cd-117e-420b-8616-052bab9070d1 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.939832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 183/364] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:10.946443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:10.947407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:10.947881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:10.971169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:10.972759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:10.985472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 182/365] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:11.039644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e7cd-117e-420b-8616-052bab9070d1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.059255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e7cd-117e-420b-8616-052bab9070d1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.064280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.065404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.065899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.066377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.087487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:11.095565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:11.097053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 184/366] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:11.103365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.113168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65dac-193a-4c96-96d4-76520933ced1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.123120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.124190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.124679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.125147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.126129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:11.126683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.128515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ad186-207a-4280-85c5-0bc4bf1bdd2e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.142377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 183/367] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.148415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.159356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdcc1-dbd5-4926-8b00-7bf36f613009 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.161019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdcc1-dbd5-4926-8b00-7bf36f613009 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.161719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdcc1-dbd5-4926-8b00-7bf36f613009 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.164041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ffc0-7c36-4722-8987-b9ace97773e4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.168571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 184/368] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:11 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:11.175388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.175674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.175950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.176521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.177432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.177925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.178387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.202051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.203805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.212190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:11.213396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:11.214035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 185/369] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:11.220207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.232995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b718e9-48b9-44c1-9a80-45eedf83465d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.234106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 185/370] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:11.242647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.243529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.243808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.244078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.251342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.253408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.255241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 186/371] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:11.261419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.268406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.276646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a4660-971e-40b6-939a-e3302110ffce None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.284895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.285777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.286059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.286332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.288650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.290584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.295520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20868e-33e4-492f-9748-bfbe64d1ce59 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.297614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 186/372] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.298812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.303204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.304108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.304389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.304662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.318226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d272-d29d-4b96-a5dc-9ee5b7eb0e40 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.328683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.329349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.330072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:11.332535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.332835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.333715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=c70c06036b134d169ca21eee42fa0624) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:11.334027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.336162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.338472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:11.341003 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 187/373] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:11.342965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 187/374] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.352435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.376432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32ecb-9528-4377-9fc9-c239d2f95908 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.387256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.387959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.388398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.388684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.389493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:11.389873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.391696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.407584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 188/375] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.414016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.428357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519f94d-89c3-43e5-b653-931c21889253 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.439261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.439927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.440205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.440473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.455259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.456945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.466771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 188/376] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:11.473244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.488157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32b578-a534-4149-9d7d-5fafae245b84 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.496149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.497094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.497424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.497776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.499135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.501071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.502881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 189/377] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.509115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.518554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a650-8407-4263-825a-88c64bf7a75a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.528112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.529331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.529610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.529883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] PATH_INFO: `/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.543300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] RBAC: Authorizing `identity:get_group(group_id=a4af4e804c2941d8a282fa1247b7f3e1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.545330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b244339-20d1-4778-8264-7acc11005895 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.547304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 189/378] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:11.554503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:11.572413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0771b1-61d9-4b84-8b48-da7ea28fed25 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:11.579861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:11.580587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:11.580871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:11.581201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:11.582098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] RBAC: Adding query filter params (group.id=a4af4e804c2941d8a282fa1247b7f3e1, role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=174ef43af8a44f289a307527e69c1f4f) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:11.582411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:11.584490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb0ee2-3f13-4396-b330-9c555f1d3dd6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:11.595275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 190/379] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:11 2021] GET /identity/v3/role_assignments?group.id=a4af4e804c2941d8a282fa1247b7f3e1&scope.project.id=174ef43af8a44f289a307527e69c1f4f&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:12.669840 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba085ae-e503-4bf3-9828-41d5b8110c67 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.670871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba085ae-e503-4bf3-9828-41d5b8110c67 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.671394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba085ae-e503-4bf3-9828-41d5b8110c67 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.673703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 190/380] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:12.682076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6a9c-e1c3-42b5-a182-418673e4d153 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.683000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6a9c-e1c3-42b5-a182-418673e4d153 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.683477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e6a9c-e1c3-42b5-a182-418673e4d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.706861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-006e6a9c-e1c3-42b5-a182-418673e4d153 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:12.708418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-006e6a9c-e1c3-42b5-a182-418673e4d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:12.721220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 191/381] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:12.764975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba085ae-e503-4bf3-9828-41d5b8110c67 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.780839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba085ae-e503-4bf3-9828-41d5b8110c67 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.788474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:12.789578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.790058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.790542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.798451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3120-c991-4039-96a8-83bea1dd427d None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.799097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3120-c991-4039-96a8-83bea1dd427d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.799570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3120-c991-4039-96a8-83bea1dd427d None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.801611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 192/382] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:12.807651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.808288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.808774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.828549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:12.837826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:12.846490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:12.848114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:12.852087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 191/383] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:12.856004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.870899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 193/384] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:12.872751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4321-8141-4757-8e63-10b8345cd316 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.885676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:12.887211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.887891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.888622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.890115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:12.890941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:12.893168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:12.906794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 192/385] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:12.913716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.918983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.929948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751217-d83c-4361-8fa3-05da551192ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.934543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b46f-dab1-4d00-b97b-1112dd16bc13 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.942385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:12.943633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.943974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:12.944423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.944872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:12.945139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.945238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:12.945412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:12.947780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:12.949858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:12.951690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 194/386] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:12.962031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.966737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:12.976466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:12.978429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 193/387] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:12.983267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3c039-be0c-4ecf-9df3-2ae0bb1b522f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.984470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:12.997902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3ee06-7c8f-49a4-a98f-6f927116631d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:12.999260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.000126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.000402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.000756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.005857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.005857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.006216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 195/388] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:13.008657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.009335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.009612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.009884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.010678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:13.010982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.012621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.013738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.029209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592bfc7-7fc6-4480-9e08-d53731fe3045 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.037927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 194/389] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:13.040519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.041426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.041701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.041970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/groups/84c37ea63a0c4cdc8377764faffe8664/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.044722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.045772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, group_id=84c37ea63a0c4cdc8377764faffe8664, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.048464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.064841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680f426-2c3a-41a8-8d51-bbaeebc1e5a1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.077975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 196/390] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Dec 23 11:46:13 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/groups/84c37ea63a0c4cdc8377764faffe8664/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:46:13.084248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.085136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.085419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.085690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.086947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.088909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.091049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 195/391] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:13.097491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.176626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f14bb9-3f97-4986-ace0-e617ede12620 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.187484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.188287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.188566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.188835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.194557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.194557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f185-658f-4913-9fe1-e7c42b4e76de admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.196302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 197/392] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:13.203238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.225112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794da8fe-d3c9-4f84-af3f-2b712d5fe7af admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.235709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.236687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.236953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.237227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/groups/84c37ea63a0c4cdc8377764faffe8664/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.244696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56cb35e4f3348fcbb83cde892ed7817, group_id=84c37ea63a0c4cdc8377764faffe8664, role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.247459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4fd43-e6b4-402d-9582-605a260e9d60 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.268517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 196/393] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Dec 23 11:46:13 2021] PUT /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817/groups/84c37ea63a0c4cdc8377764faffe8664/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:13.397889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c37-1b57-435e-86c8-c7d3478f881d None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.398567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c37-1b57-435e-86c8-c7d3478f881d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.399035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d8c37-1b57-435e-86c8-c7d3478f881d None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.401180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 198/394] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:13.407707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.407993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.408257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.438754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:13.439902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:13.512065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 197/395] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:13.539630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8c37-1b57-435e-86c8-c7d3478f881d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.553036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d8c37-1b57-435e-86c8-c7d3478f881d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.559532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.560892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.561397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.561862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.573609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:13.581465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:13.583424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 199/396] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:13.589372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.600546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941de266-4130-42f6-9a10-0c59d14f8eb6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.605413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.606347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.606904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.607481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.608490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:13.609027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.610864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.620955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 198/397] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:13.626995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.637693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f024a-730c-4186-ad82-66dd6001bfef admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.642682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.643877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.644344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.644838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.646257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.648456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.650447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 200/398] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:13.656488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.668477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06117c9-a7dc-4e25-9a4c-4a3d41042c71 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.674334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.675309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.675589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.675861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.677206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.679473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d2a04-f59c-4789-b4c1-f39a96167a58 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.681239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 199/399] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:13 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:13.687600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:13.700179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a131f92-db61-4e09-8e45-46798de4f1a5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:13.705246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:13.706198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:13.706482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:13.706784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/groups/84c37ea63a0c4cdc8377764faffe8664/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:13.708883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, group_id=84c37ea63a0c4cdc8377764faffe8664, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:13.711759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba4142-014a-4cfe-bafd-f82b4df31c5d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:13.728234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 201/400] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Dec 23 11:46:13 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/groups/84c37ea63a0c4cdc8377764faffe8664/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:46:14.402872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c029-1a7a-4b66-8ef0-b4d41c0ece3c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.403502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c029-1a7a-4b66-8ef0-b4d41c0ece3c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.404890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c029-1a7a-4b66-8ef0-b4d41c0ece3c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.407295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 200/401] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:14.413543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.414106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.414607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.439807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:14.441348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:14.515349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 202/402] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:14.560789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c029-1a7a-4b66-8ef0-b4d41c0ece3c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:14.573998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c029-1a7a-4b66-8ef0-b4d41c0ece3c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:14.583223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:14.584327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.584804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.585292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.597536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:14.604754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:14.610696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 201/403] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:14.613971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:14.624522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543ba4-f8da-4e8e-a2f0-42506438d8a0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:14.631168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:14.632105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.632579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.633064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.634091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:14.634640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:14.636508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:14.650756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 203/404] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:14.657678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:14.669081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc8f05-2f2e-4d86-9a51-023290a3f78d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:14.674344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:14.675917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.676415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.676909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] PATH_INFO: `/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.678339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] RBAC: Authorizing `identity:get_group(group_id=a4af4e804c2941d8a282fa1247b7f3e1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:14.682365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:14.684325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 202/405] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:14 2021] GET /identity/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:14.690791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:14.703794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be8467-c886-4d2e-8068-5ddff90745be admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:14.714170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:14.715458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.715971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.717137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.718588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:14.720619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0a89a-b483-403f-9645-2da0d33a71d0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:14.722889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 204/406] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:14 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:14.728828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:14.740063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e63c6-d500-49ba-82a1-d1f90082ca43 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:14.745355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:14.750535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:14.751237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:14.751713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f/groups/a4af4e804c2941d8a282fa1247b7f3e1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:14.754150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174ef43af8a44f289a307527e69c1f4f, group_id=a4af4e804c2941d8a282fa1247b7f3e1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:14.757108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c3f4-3113-4960-955d-ab8629fe4e33 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:14.773550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 203/407] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Dec 23 11:46:14 2021] PUT /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f/groups/a4af4e804c2941d8a282fa1247b7f3e1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:15.161864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7af0-46cd-4c40-876b-1eeb90aecbfc None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.162604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7af0-46cd-4c40-876b-1eeb90aecbfc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.163084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd7af0-46cd-4c40-876b-1eeb90aecbfc None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.165152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 205/408] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:15.175997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.176623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.177088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.199302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:15.201117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:15.279430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 204/409] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:15.305259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd7af0-46cd-4c40-876b-1eeb90aecbfc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:15.320593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd7af0-46cd-4c40-876b-1eeb90aecbfc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:15.327692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:15.328562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.328847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.329116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.346463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:15.355385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:15.355385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 206/410] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:15.362005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:15.374958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48593c-83e8-4e55-8a83-0d2b5947a42f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:15.386922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:15.387723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.388093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.388482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.389378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:15.389733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:15.391465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:15.407751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 205/411] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:15.414107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:15.431422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38e287-3c34-4e2b-bd2e-ab4c6bb9a463 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:15.438841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:15.439717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.439990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.440260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.447260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:15.449181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:15.450920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 207/412] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:15 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:15.457220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:15.471694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5b81-42cd-4172-b93a-d40ea73efb26 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:15.482735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:15.483620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.483896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.484167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.491304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:15.493388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bd45-1957-495a-8b21-53dd5c7b773a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:15.495145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 206/413] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:15 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:15.501532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:15.515579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d108ee-5df8-478c-b3db-e7b877275f75 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:15.525524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:15.526418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:15.526723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:15.526998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624/groups/84c37ea63a0c4cdc8377764faffe8664/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:15.531828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70c06036b134d169ca21eee42fa0624, group_id=84c37ea63a0c4cdc8377764faffe8664, role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:15.534487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad455c44-b253-4a4a-9af8-da9e5ea023e3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:15.556670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 208/414] 10.222.0.65 () {58 vars in 1463 bytes} [Thu Dec 23 11:46:15 2021] PUT /identity/v3/projects/c70c06036b134d169ca21eee42fa0624/groups/84c37ea63a0c4cdc8377764faffe8664/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:16.298760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460e61-fce8-4abc-94b8-1e0571ac750f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.299830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460e61-fce8-4abc-94b8-1e0571ac750f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.300303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460e61-fce8-4abc-94b8-1e0571ac750f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.302640 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 207/415] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:16.308943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.309917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.310576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.333919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:16.335487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:16.419935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 209/416] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:16.445109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460e61-fce8-4abc-94b8-1e0571ac750f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.458388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3460e61-fce8-4abc-94b8-1e0571ac750f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.463093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.463902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.464174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.464439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.477729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:16.485287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-4028b454-3b7c-46bb-8485-9b998eed9949 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:16.490621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 208/417] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:16.493736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.503454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedc70-7853-4104-94e7-37892a4b69cb None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.508857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.509532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.509808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.509968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1eb5-1c28-43a4-8a0d-b10366e22489 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.510129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.510289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1eb5-1c28-43a4-8a0d-b10366e22489 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.510429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b1eb5-1c28-43a4-8a0d-b10366e22489 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.510867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:16.511166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.512404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 209/418] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:16.514755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.519330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.519613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.519890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.529178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 210/419] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.539225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.552344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:16.554005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:16.556333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7b82-9d71-43ea-b29d-2983ef74ae96 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.566475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.567453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.567935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.568404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.576186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 210/420] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:16.584796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.586874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e425f-3671-4d01-a4f5-639b47198c6f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.600740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 211/421] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:16.606727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.609531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b2b6-2061-4fba-8d48-9c143a2027da None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.610023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b2b6-2061-4fba-8d48-9c143a2027da None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.610437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1b2b6-2061-4fba-8d48-9c143a2027da None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.612625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 212/422] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:16.618803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.619250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.619686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.622381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f252-b561-4edb-a991-1237f68cb57a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.632146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.633307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.633767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.634232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.636306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.638669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.641070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 211/423] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.642190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.652723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:16.654421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:16.659599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9efbc-7615-4801-8ecf-9f6d336e84ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.664115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.665154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.665668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.666124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 213/424] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:16.666370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.667205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.677679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07abef-8ed1-43b4-aabb-2a8bf3ac7c27 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.684791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:16.685694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.686759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.687173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.687578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.688911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.691025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.693133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 214/425] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.693773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 23 11:46:16.694279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.699362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 212/426] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:16.701907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.705109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62613a3-5b3f-4fd2-8fb9-5c12462060ad admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.709723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.710832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.711521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.711981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.716776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef098f-94cb-4480-a9e8-ab826565bcac admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.724861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.725787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.725917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:16.726332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.726998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.728092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:16.728560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.730697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.734617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:16.736590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 215/427] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:16.737522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.738417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 213/428] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:16.742794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.751797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea47b-ca3f-4a96-9382-0501b760cb5a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.757581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.758602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.758946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.759278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.760155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:16.760518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.761437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e79d82-f6ab-4f50-9f5b-8cdf23420961 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.766545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.775191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 216/429] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.776972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.777665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.777946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.778707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.779466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:16.779781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.780217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.781370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.792336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235280-acd5-43ba-b407-9701d90118a4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.798248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 214/430] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.798983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.799871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.800384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.800891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.804116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.811479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.813686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.824706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 217/431] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:46:16.829085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd032-a515-454f-9106-7df7cac0c937 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.831047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.839066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.839739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.840019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.840299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.846031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6fcc7-900c-4066-9ca3-1e87ba7b6dad admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.857385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.858918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.860740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.861278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.862551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.864486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.865735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.870097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.874846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 218/432] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:16.881045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.888382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 215/433] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:46:16.895004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.900778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e244bb1-a18c-4e82-9233-0e3b27447625 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.911045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b559-52af-47f6-bbea-4d66caac95f1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.912132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.913580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.915344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.916341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.919720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.924270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.924821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.926089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.926997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.927714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.929338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 219/434] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:16.931300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.933683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.936434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 216/435] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:16.937288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.943032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.954891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3aea4-4c14-4822-a8b8-8c5191c8268a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.957227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7b793-1b0e-4ebd-ba70-1afabad82e62 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:16.963943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.965256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.965774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.967016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.969993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.976916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:16.979981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 217/436] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:16.982373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:16.983271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:16.983581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:16.983871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:16.984797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=f1a3aae1c2fd48f5acf67dee2a2532ed, scope.project.id=c70c06036b134d169ca21eee42fa0624) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:16.985133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:16.986730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:16.987400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccde7c5-5d3c-46d8-bfe2-38c701c7fe3c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:17.001014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 220/437] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=f1a3aae1c2fd48f5acf67dee2a2532ed => generated 611 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:17.002603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7f5f-471b-4297-9c91-84030aa11ab9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:17.007850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:17.009003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:17.009536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:17.010052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:17.011261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=b56cb35e4f3348fcbb83cde892ed7817) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:17.011827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:17.014163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ab968-64d3-4466-a983-28d08318628a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:17.024316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 218/438] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:16 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=b56cb35e4f3348fcbb83cde892ed7817&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:18.204496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68427-58c8-43ec-be7e-ea29f83f531d None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.205046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68427-58c8-43ec-be7e-ea29f83f531d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.205046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68427-58c8-43ec-be7e-ea29f83f531d None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.206838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 221/439] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:18.212891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.213353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.213561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.231389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:18.232626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:18.241252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 219/440] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:18.265080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a68427-58c8-43ec-be7e-ea29f83f531d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.279207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a68427-58c8-43ec-be7e-ea29f83f531d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.284306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.285108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.285383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.285635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.296410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:18.303150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:18.304304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 222/441] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:18.310874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.320085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e77f-8588-402c-9f13-90e0e7cfd728 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.325507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.326178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.326489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.326787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.327558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:18.327863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.329470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.338339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 220/442] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.344899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.355974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dadf-4c14-4e4c-9ae0-2a08aacb2fff admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.361986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.362662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.362944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.363216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.371573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.373368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.382150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 223/443] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:18.388670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.399388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d66aa7-3a3f-49d4-a66b-c11f303aa2e3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.404618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.405486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.405760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.406024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.407341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.409120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.410816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 221/444] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.416820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.426261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352199a8-eae8-4649-aa7a-bfada3dafe43 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.431613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.432469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.432739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.433002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] PATH_INFO: `/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.434289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] RBAC: Authorizing `identity:get_group(group_id=a4af4e804c2941d8a282fa1247b7f3e1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.436300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f9c01-8396-473b-ac64-71eac9327733 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.437903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 224/445] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/groups/a4af4e804c2941d8a282fa1247b7f3e1 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.444217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.454874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f096b-434a-4ae4-8827-0c1bc555e6f2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.460110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.460754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.461028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.461275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.462113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] RBAC: Adding query filter params (group.id=a4af4e804c2941d8a282fa1247b7f3e1, role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=174ef43af8a44f289a307527e69c1f4f) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:18.462415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.464294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb358674-50cf-4bfe-a825-ddd4bfdaf816 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.470550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 222/446] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/role_assignments?group.id=a4af4e804c2941d8a282fa1247b7f3e1&scope.project.id=174ef43af8a44f289a307527e69c1f4f&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.557216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236c58-5c6f-4c65-a7a5-ce7a1c05e203 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.557471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236c58-5c6f-4c65-a7a5-ce7a1c05e203 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.557752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236c58-5c6f-4c65-a7a5-ce7a1c05e203 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.559600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 225/447] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:18.566082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.566592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.566727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.585739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:18.586983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:18.595805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 223/448] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:18.620398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236c58-5c6f-4c65-a7a5-ce7a1c05e203 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.635287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236c58-5c6f-4c65-a7a5-ce7a1c05e203 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.640903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.641724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.642000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.642263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.654740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:18.662102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:18.663411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 226/449] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:18.670164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.680214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0356-75f3-4cbf-94c5-93087d2746c1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.686696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.687367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.687639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.687909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.688680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:18.688956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.690539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.700948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 224/450] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.709458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.719592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a675d-b098-4f25-b57d-b59c7cd59285 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.724191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.724852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.725131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.725411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.734966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.736693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.746155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 227/451] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:18.752551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.762192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f2ab5-fffa-4ca8-bc10-1d7b75746a05 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.767226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.768077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.768352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.768616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] PATH_INFO: `/v3/projects/c70c06036b134d169ca21eee42fa0624` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.769877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] RBAC: Authorizing `identity:get_project(project_id=c70c06036b134d169ca21eee42fa0624)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.771949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.773573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 225/452] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/projects/c70c06036b134d169ca21eee42fa0624 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:18.780027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.794745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386f945-4624-41c7-acd0-fa337621a651 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.803491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.804768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.805147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.805563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] PATH_INFO: `/v3/groups/84c37ea63a0c4cdc8377764faffe8664` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.807361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] RBAC: Authorizing `identity:get_group(group_id=84c37ea63a0c4cdc8377764faffe8664)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.810357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ffda8-c298-425c-8cdf-bb9ccf54c262 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.811983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 228/453] 10.222.0.65 () {56 vars in 1201 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/groups/84c37ea63a0c4cdc8377764faffe8664 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:18.818314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:18.829681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0163-3bb0-4d29-895f-aaa411e7973e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:18.835439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:18.836085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:18.836367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:18.836640 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:18.837483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] RBAC: Adding query filter params (group.id=84c37ea63a0c4cdc8377764faffe8664, role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=c70c06036b134d169ca21eee42fa0624) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:18.837795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:18.839741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc4274-d965-4857-b4be-beab4852bed0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:18.846092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 226/454] 10.222.0.65 () {56 vars in 1397 bytes} [Thu Dec 23 11:46:18 2021] GET /identity/v3/role_assignments?group.id=84c37ea63a0c4cdc8377764faffe8664&scope.project.id=c70c06036b134d169ca21eee42fa0624&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:21.779081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edc88-6497-4349-9ae8-24478c586b28 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:21.780148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edc88-6497-4349-9ae8-24478c586b28 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:21.780148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edc88-6497-4349-9ae8-24478c586b28 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:21.781637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 229/455] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:21.804849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb214-0e4f-4187-9281-b545c7575298 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:21.805796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb214-0e4f-4187-9281-b545c7575298 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:21.806262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb214-0e4f-4187-9281-b545c7575298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:21.834850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b04cb214-0e4f-4187-9281-b545c7575298 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:21.836386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b04cb214-0e4f-4187-9281-b545c7575298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:21.848971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 227/456] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:21.896926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edc88-6497-4349-9ae8-24478c586b28 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:21.916398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edc88-6497-4349-9ae8-24478c586b28 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:21.927184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:21.928314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:21.928792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:21.929261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:21.943594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:21.945769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:21.969598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:21.969784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bad7-64ef-4afe-a686-0e9e3460964e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:21.969990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bad7-64ef-4afe-a686-0e9e3460964e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:21.970201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8bad7-64ef-4afe-a686-0e9e3460964e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:21.971639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 230/457] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:21.975234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 228/458] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:21.978367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:21.980975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:21.981430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:21.981763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:21.994243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873732-ce37-4c1f-bcc7-d63464415e6e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.006428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.007433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.007908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.008394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.009325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:22.009837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.011105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:22.011105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:22.011105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:22.012486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.019189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:22.022919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:22.042476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 229/459] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:22.049250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 231/460] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:22.055286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.071491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7bced-6772-47c7-a5dc-157193b256a8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.076098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.079453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.080368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.080866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.081397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.082329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.085973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad038d47-f036-485d-be44-d09d746bc7f1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.087768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.104218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.105960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.109545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.110156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.118229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 230/461] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:22 2021] POST /identity/v3/users => generated 246 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:22.135127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.137301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.160050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-fc8b5897-b2c4-4bf9-97de-bff7faaf3a22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:22.161907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 232/462] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:22.168439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.178105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccafd4-7d98-4db8-b51a-781591aaae18 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.178680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccafd4-7d98-4db8-b51a-781591aaae18 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.179126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccafd4-7d98-4db8-b51a-781591aaae18 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.180581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6175724-d562-41da-9fc0-663baf522e2a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.181527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 233/463] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:22.187460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.188475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.188931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.189378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.190323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:22.190858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.192827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.197326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.197862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.198306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.228238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 231/464] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:22.229546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:22.230997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:22.239129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.252700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cbb44-e0f1-4213-afb7-7815ee0f028b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.254922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 234/465] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:22.262101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.262101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.262101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.262101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.262462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.262681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.295394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 232/466] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:22 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:22.296908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.312404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb7af-60fe-483b-9c45-cc541e56172f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.330607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.331453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.331735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.332006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.350286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.352604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.386890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:22.388589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 235/467] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:22.395478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.409332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcffb-a37e-475c-8c43-bdd16e51d7ab admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.428952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.429649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.429927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.430199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.431006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:22.431317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.433041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b010f7-d3d4-4bc5-8577-149cfe1abcaf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.452556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 233/468] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:22.453913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:22.471309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55fd95-f475-4d9b-9556-4cad0ec5ec5f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:22.480251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:22.480955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.481237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.481513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.482758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:22.484504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2534c8-104e-4dff-89f1-ab0b1b9fcb48 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:22.517126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 236/469] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:22 2021] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:22.980900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032611f9-59bc-4cd6-9d5d-91b5f4670c68 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.981706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032611f9-59bc-4cd6-9d5d-91b5f4670c68 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.981706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032611f9-59bc-4cd6-9d5d-91b5f4670c68 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:22.983732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 234/470] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:22.989506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290de812-9975-451b-870f-b2e735d05f0e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:22.990053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290de812-9975-451b-870f-b2e735d05f0e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:22.990053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290de812-9975-451b-870f-b2e735d05f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.012113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-290de812-9975-451b-870f-b2e735d05f0e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:23.013384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-290de812-9975-451b-870f-b2e735d05f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:23.027599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 237/471] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:23.076729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032611f9-59bc-4cd6-9d5d-91b5f4670c68 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.094103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032611f9-59bc-4cd6-9d5d-91b5f4670c68 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.098871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.099909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.100381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.100860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.112212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:23.114329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:23.132487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:23.134314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 235/472] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:23.141484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290de812-9975-451b-870f-b2e735d05f0e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.155692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290de812-9975-451b-870f-b2e735d05f0e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.166730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.167426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.167709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.167980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.168738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:23.169089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:23.171055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600d46-2d04-4e96-89e2-a7d38c88d3ad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:23.191927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 238/473] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:23.197571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.211503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8829db-53bd-431a-856d-88a579184968 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.218742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.219731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.220208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.220670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.221590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:23.223798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1c7bf-0b05-47a1-8a58-ea22ddf38b6d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:23.253353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 236/474] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:23 2021] POST /identity/v3/users => generated 249 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:23.553079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c52123-dccb-4045-a931-5042d5ae281e None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.553464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c52123-dccb-4045-a931-5042d5ae281e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.553659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c52123-dccb-4045-a931-5042d5ae281e None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.555852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 239/475] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:23.562288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.562601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.562877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.586411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:23.587645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:23.598202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 237/476] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:23.623395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c52123-dccb-4045-a931-5042d5ae281e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.640925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c52123-dccb-4045-a931-5042d5ae281e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.646782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.647451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.647725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.647989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.648760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:23.649775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:23.649775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:23.649775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:23.650694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:23.661189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.sql.core [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 23 11:46:23.661189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 23 11:46:23.661189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [parameters: {'id': '4968823cc5574fd2967d361f88878330', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 23 11:46:23.661189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 23 11:46:23.681132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 23 11:46:23.686557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 240/477] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:46:23 2021] POST /identity/v3/roles => generated 144 bytes in 60 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:23.691747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.707592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9f428-e6b0-4095-aa71-02aa8d58d926 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.716065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.716984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.717266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.717538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.735949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:23.743716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a3133d67-c0e3-4ced-9731-42c5c9251f42 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 23 11:46:23.745278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 238/478] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:23.753451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:23.766766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0bb0-b600-4581-83c6-3674ff790897 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:23.775333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:23.776030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:23.776302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:23.776570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:23.777556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:23.777858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:23.779670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380a4e-46c2-4a0f-9132-ce986a468231 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:23.792360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 241/479] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.214352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bb33-b383-4b64-baba-f9bac6e67688 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.215403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bb33-b383-4b64-baba-f9bac6e67688 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.215943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1bb33-b383-4b64-baba-f9bac6e67688 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.218171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 239/480] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:25.224510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.224975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.225176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.250902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:25.252092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:25.266249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 242/481] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:25.302373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1bb33-b383-4b64-baba-f9bac6e67688 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.320468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1bb33-b383-4b64-baba-f9bac6e67688 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.330648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.331806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.332297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.332765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.366492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:25.375779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-d1203f45-16fb-48ae-b3d5-7d6edf8c48c1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:25.377281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 240/482] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.383595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.405440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e764-7530-46d6-ab34-0ce9dc809e0a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.420426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.421145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.421428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.421707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.422483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.422824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.424481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.444374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 243/483] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.449865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45c61-bbe0-49c5-a0eb-532d5add97ff None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.450395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.450746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45c61-bbe0-49c5-a0eb-532d5add97ff None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.451359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45c61-bbe0-49c5-a0eb-532d5add97ff None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.453606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 241/484] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:25.459631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f878f-144c-4363-8024-327ba85b6f89 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.460185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f878f-144c-4363-8024-327ba85b6f89 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.460652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f878f-144c-4363-8024-327ba85b6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.463117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622c285-30d7-4dd0-88fa-18e0039c74ca admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.470661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.471398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.471679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.471950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.481236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a46f878f-144c-4363-8024-327ba85b6f89 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:25.482811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a46f878f-144c-4363-8024-327ba85b6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:25.491338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 242/485] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:25.495212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.496846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cca-0fa8-48d9-88df-82bec16dc6c2 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.496982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.497716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cca-0fa8-48d9-88df-82bec16dc6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.498186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905cca-0fa8-48d9-88df-82bec16dc6c2 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.500411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 243/486] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:25.507915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.508495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.508959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.523098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:25.524593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 244/487] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.525540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.536660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:25.536825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11af7b-821c-49ef-a038-76750640704a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.538471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:25.541295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.542123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.542367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.542675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.547810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 244/488] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:25.548850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.569190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628db1c9-39bd-4d4b-a1b5-180f727b07f6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.570166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:25.578474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:25.579039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.579728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.580057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.580330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.581078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 245/489] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.581183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.581385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.582448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.583123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.592923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3232488-3a13-4a01-8014-677969aed9ce admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.597067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 245/490] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.602833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.603112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.603942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.604224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.604601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.614017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d569d9-a3e6-42b9-be1b-e25d5b729a23 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.617713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:25.619602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.620534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.621008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.621472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.622625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.623127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.624738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:25.625119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.630593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 246/491] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.631714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.639880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 246/492] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.640797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.646182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974825-5810-46c3-917b-23a59356d485 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.650851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447a73-4844-4a5f-9ceb-cea6476634ac admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.652119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.653359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.654400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.655161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.656954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.657850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.658271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.658709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.659717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.660217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.662207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.663819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.666829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.674492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 247/493] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.674492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.688650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a6ebc-ec24-416d-9d45-8a4972d03eca admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.692067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:25.693424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 247/494] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.694172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.694293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.695375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.695938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.696403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.712611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.713915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1815b-8ce4-43bc-9530-221628dc8841 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.715230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.719339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.720137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.720419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.720751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.735627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:25.736814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.737805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 248/495] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.742803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.742927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.753838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f11b-1ded-4195-9804-01ad6b530a20 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.758252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.758951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.759233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.759505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.760364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.760655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.761684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:25.761684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:25.761684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:25.762883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.765381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:25.766887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 248/496] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.767917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.781113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2075623-9bdc-454c-93e5-c3dc214b952c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.786112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.787147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.787685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.788167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.789181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.789682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.791790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.805597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 249/497] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.806842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.813189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 249/498] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.814314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.818113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185969a-c746-487d-869c-d57aa1c715dd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.822927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.823849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.824416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.824788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e806a-eb7d-434e-8700-6a347d11505d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.825350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.827022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.827928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.830216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.831489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.832684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.833317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.833821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.845576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 250/499] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.846747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.851293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.854189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.857716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32265ae-ddc2-4e12-9c13-14e6acaec41f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.862343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.863251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.863763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.864249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.871158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 23 11:46:25.872730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 250/500] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.873629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.874244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.876221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.883984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd117d6-2612-4895-9f07-fb36b725f6a9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.886784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 251/501] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:25.887956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.894141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.895136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.895374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.895650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.899495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6624a0-7fb6-40c4-99dc-5d22a91e4707 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.904594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.904833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.905767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.906269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.906808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.907006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.908285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.908810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.910065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:25.910065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:25.910065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:25.911633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.923631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 23 11:46:25.930390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 251/502] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.931429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.941861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f72030-6369-4b8d-a292-491f51e218d5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.946679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.947524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.947807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.948083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.956575 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 252/503] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:25.957681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:25.960675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.962717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.968424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f443210-e578-46cc-97f0-e9914648dacd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:25.974323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:25.975284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:25.975766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:25.976233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:25.977274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:25.977791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:25.979910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:25.982807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:25.984053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 252/504] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:25.989864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.000635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 253/505] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.001856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.006101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eea06-ce84-4869-a134-1cb025a51f5c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.011474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.012179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.012460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.012856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.013895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336961-39b8-4522-ad2d-296bf0165c6e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.018562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.019479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.019978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.020446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.021388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.021889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.022076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.023934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.024059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.033714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 253/506] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:26.034701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.037450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 254/507] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.039495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.049133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9863-0964-4dae-943d-f3546e9281b8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.050844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983788a-3979-40d1-9353-fffca7b7b84e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.054092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.054778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.055065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.055378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.058061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.059235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.059799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.060424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.064253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.066086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.073034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.075826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.080633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 254/508] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:26.081579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.091458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785bf06-aa87-4121-80aa-d79b833d970c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.095271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:26.096174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.096994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.097291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 255/509] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:26.097391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.097580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.098762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.105845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.108266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.109439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87b088-34e8-4d09-9cf1-49a484763a7e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.114063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.115137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.115950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.116416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.124218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:26.128521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.130621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 255/510] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.130868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.131543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.141666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b817a-459d-4f5e-8806-e234c8845588 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.146393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.147125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.147409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.147736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.148476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.148830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.150462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.151277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:26.152689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 256/511] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.153863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.163998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0a7bb-7c22-42f5-800c-fe5d5dc99431 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.168263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 256/512] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.169112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.169314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.170255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.170794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.171263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.172468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.173178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.174410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:26.174410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:26.174410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:26.176067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.179469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434746e-7c9d-4370-bf7c-33fff7ccf7fa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.188806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.189535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.189819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.190549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.190909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.191217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.193006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.199141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 257/513] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.200309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.211967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090152-f6ff-4fbf-9412-b7e94883223d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.214585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 257/514] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.216077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.225199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.226697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.227179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.227648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.228182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b1118-3796-499f-9f31-045f6a9f7482 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.233379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.234179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.234467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.234785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.235716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.236049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.238169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.238476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.240992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.244698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 258/515] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.245498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.257788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:26.259831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 258/516] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.266360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.268268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8ff05-cdb5-4036-a9e1-6ab67d0685a0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.278346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c12c-bfc4-4e95-9083-4d9dbfac5616 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.281081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.282045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.282314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.282638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.285362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.286385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.286900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.287426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.288541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.289052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.292277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.299880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.301992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.308388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 259/517] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.315019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.328426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab2582-3b56-4bc2-aa8c-ba81759c3540 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.333155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.333811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.334139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.334414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.335355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=049a0120570d4d6e94d4d10a7460226d) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.335657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.337549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:26.337757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3ad7b-3522-4614-9031-cf776c6d5855 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.338862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 259/518] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.344666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 260/519] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/role_assignments?user.id=049a0120570d4d6e94d4d10a7460226d&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.347720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.352643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff40-90cb-4ecb-a7c3-8f79d31eb811 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.353262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff40-90cb-4ecb-a7c3-8f79d31eb811 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.353734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ff40-90cb-4ecb-a7c3-8f79d31eb811 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.356286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 261/520] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:26.369216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.369762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.370242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.374064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762813-055f-4476-9344-dcbf4a8d3a6f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.393846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.395037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.395573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.396105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.397227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.397800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.401876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:26.401876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:26.401876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:26.403834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.415968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:26.426087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:26.442635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 262/521] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:26.450988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 260/522] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.457781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.474540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ebdce-e8ae-42ce-b51f-9ba2fffe7777 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.486064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.487202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.487720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.488226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.489370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=16cff1dd38b24c53b75703647fddd213) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.489934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.492797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.502354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.503665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 263/523] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/role_assignments?user.id=16cff1dd38b24c53b75703647fddd213&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.519557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a774c-4d79-449a-859b-1bf33242f0a2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.532287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.533201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.533482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.533756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.555521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:26.562897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:26.564236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 261/524] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:26.571343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.583845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863fc16-c600-49c7-9534-efcd138d45a9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.588796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.589567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.589845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.590166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.591118 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.591545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.593401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.603731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 264/525] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.610262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.621404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15336656-06ec-45e3-b6e8-45e2ee07cf89 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.626675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.627544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.627823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.628144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.641339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.643355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.663354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:26.664948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 262/526] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.671435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.681858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced3b22-79be-4875-b7ba-f462b7d840ac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.688515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.689879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.690321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.690644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.691480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.691842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.693558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.710330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 265/527] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.716428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.727711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f43e7c-65a2-4ed8-97e1-d4f0b0132104 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.732580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.733447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.733724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.733996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.744509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.746570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.761587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 23 11:46:26.763310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 263/528] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.769306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.779292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b4fe2-44c3-493c-938b-6dee814b33ac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.783856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.784534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.784813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.785081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.785931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.786235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.788155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.807660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 266/529] 10.222.0.65 () {56 vars in 1160 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:26.813694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.823570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb263de0-85f7-4baa-8592-4fca7ba78008 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.828251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.828899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.829179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.829452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.837776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.839554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2eec0-d5f5-496b-af9f-403b9c99984e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.849321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 264/530] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:26.855358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.863815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f288-ffeb-467c-bb13-634f4754b288 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.864096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f288-ffeb-467c-bb13-634f4754b288 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.864369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f288-ffeb-467c-bb13-634f4754b288 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.866626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 265/531] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:26.869896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8e6f-76e6-48f3-89e9-13cfdce92ad4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.875734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.876592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.878033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.882325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.883381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.884471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.884903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.902776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.907368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.921236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:26.922698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:26.939734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 266/532] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:26.944203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:26.945802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 267/533] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:26.951555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.963474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d41ca3-3c7e-4ddc-8469-76ec910d92de None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.967474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:26.977223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.977900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.978181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.978456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:26.979239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:26.979547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:26.982620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007da9-ff42-4fc2-8e84-46468d4b69e5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:26.984267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:26.993736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:26.994776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:26.995004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:26.995274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.011405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 267/534] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:27.012341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.014227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.017155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:27.035591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9d92-9e7a-434b-88ec-12ab9e02b4d0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:27.048423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:27.050326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:27.051171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:27.051428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:27.051700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.054645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 268/535] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:27.059168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:27.061193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.063645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.075274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860063a-6064-4b98-9729-8720f7c32154 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:27.082542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:27.082542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:27.082542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:27.082542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.082973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:27.082973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.084589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.099735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:27.101244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 268/536] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:27.102330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 269/537] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:27.108225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:27.111781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:27.129903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beddf-63ca-4821-a7b0-789a072c82cb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:27.132139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934e647-427c-4d5b-911d-b9bd2181a907 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:27.139427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:27.140574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:27.141770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:27.142234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:27.143081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:27.143525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.144489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:27.144948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:27.145380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.145841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.146739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.148824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53172d8f-87fa-4158-a0b5-74776a5d7904 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.152480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.165435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 269/538] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:27.174458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:27.190211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a036-56fd-4833-bcf4-c1ab34de9a8a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:27.193266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 270/539] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:27 2021] POST /identity/v3/users => generated 247 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:27.196718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:27.197757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:27.198361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:27.198929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:27.200195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=ec66b04133444ff889865e3943181507) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:27.200712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:27.203735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d84a8-144c-4a24-be8b-ed03eb7a136e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:27.211127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 270/540] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:27 2021] GET /identity/v3/role_assignments?user.id=ec66b04133444ff889865e3943181507&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.059155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874451a9-1fe4-4662-a5b2-109b0872a9ec None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.060100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874451a9-1fe4-4662-a5b2-109b0872a9ec None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.060513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874451a9-1fe4-4662-a5b2-109b0872a9ec None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.062807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 271/541] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:29.068508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.070380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.070875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.094849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:29.096465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:29.110488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 271/542] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:29.154169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874451a9-1fe4-4662-a5b2-109b0872a9ec None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.167479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874451a9-1fe4-4662-a5b2-109b0872a9ec None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.178751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.179965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.180472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.180941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.195047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:29.202941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:29.204905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 272/543] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.210916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.220558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a18ef-4343-46ba-a8ef-3a14b3a1d961 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.225460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.226465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.231152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.231730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.232755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.233317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.235280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebc47-b9d0-470a-b5b6-1cd097075f8f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.245291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 272/544] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.251312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.261552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5715b8-3f21-462c-910d-e258c7af3641 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.270198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.271373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.271849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.272336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.284269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.286420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.304563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:29.306570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 273/545] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.311645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b4108-612c-4ff2-98e6-7ca61dbe1957 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.311897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b4108-612c-4ff2-98e6-7ca61dbe1957 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.312139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b4108-612c-4ff2-98e6-7ca61dbe1957 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.312499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.314198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 273/546] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:29.319966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.319966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.320316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.323326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34adceb-5e1d-4cb8-85b1-76021b6737f0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.336124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.336797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.337076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.337347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.338103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.338389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.338826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:29.340012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.340119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:29.356730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 274/547] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:29.362534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 274/548] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:29.366850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.390220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b11d52-9191-4ca7-b4a6-35d14c90d333 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.392212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.404633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1c7b6-1f13-48d5-b445-a051b8c80d2e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.405870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.406695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.406967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.407229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.417098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.419199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.420680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.421490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.421761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.422024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.445466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:29.447127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 275/549] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.448383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:29.455841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:29.456963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.457304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 275/550] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:29.478532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.481086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7335-b4d5-43f7-a576-ad0b13abf3f9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.488747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.489444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.489723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.491248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.492368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.492528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eaa2c-c47d-439a-8016-0bc30ea1be5a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.492665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.495543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.498255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.499025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.499504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.499604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.500383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.500746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.502393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.514317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 276/551] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:29.520303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.540695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce1cea-6647-4218-af98-c7935f9bc22b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.546611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 276/552] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.552981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.563220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016255d7-96c2-4512-8868-032152a2da3d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.567471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.567471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.567471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.567471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.578656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.579792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.580284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.580766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.582656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.585959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.601568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.603826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.616273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:29.625034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 277/553] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.628794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.642413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-116aa4db-420f-4b1a-88d1-fa1571c9f698 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:29.642799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7573115-8d2d-4aef-b20c-3a6c6eaeeaee admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.644597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 277/554] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:29.646094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fecd5-6b7d-4812-915a-8a9d422800ee None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.646598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fecd5-6b7d-4812-915a-8a9d422800ee None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.647059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fecd5-6b7d-4812-915a-8a9d422800ee None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.649213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 278/555] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:29.650106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fecd5-6b7d-4812-915a-8a9d422800ee None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.651440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.655460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.655460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.655460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.655460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.655460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.655904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219db724-245d-4e7b-b314-c2d224957f46 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.668174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fecd5-6b7d-4812-915a-8a9d422800ee None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.675423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 278/556] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:29.675423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.675423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.675423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.679317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.680350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.680817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.681271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.682205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.682728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.684685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.694201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:29.695996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:29.699003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 279/557] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.700435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.718598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 279/558] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:29.721442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c03ad-e116-4019-bf0c-1032a8627f8b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.722453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.733962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.735154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.735625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.736066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.737830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e93782-a178-4fec-98bf-cba6515fabba None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.743766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.744889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.745376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.745733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.746137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.748724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.754967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.757466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.764067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 23 11:46:29.770567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 280/559] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/users/glance => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.771633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.771789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:29.773581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 280/560] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.779416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.786128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bf971-8f31-4ccb-b55c-8176a8e6cc38 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.790899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.791774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.792123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.792474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.792997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b6fb1-49ef-45d5-9040-59e10d5aca8f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.798173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.799663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.800326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.800969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.802677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.803158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.804587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:29.805482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.811731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:29.818651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 281/561] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.819480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.834384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb904441-da0a-42c1-8a8c-ffce91a94d45 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.834746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 281/562] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.836101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.839355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.840089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.840479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.840906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.841934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.842326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.844699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.848278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b7ae-4130-4ed5-8ea6-bc2243a9b338 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.852974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.853839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.854283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.854832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.855782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:29.856289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.858230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 282/563] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.858342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.864405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.869337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 282/564] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:29.870490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.882634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf77a6-82de-4c14-b296-5d0c089ce2ac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.883275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccdedc-0458-4c06-9c46-016605ca2569 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:29.888987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.889950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.890237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.890553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.891442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:29.892554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:29.893040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:29.893497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:29.902818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.904662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.910083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=1a96bba0782248589ec206a1c8c9747e, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:29.913035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:29.926457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:29.932794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 283/566] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:29.932794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.933415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 283/566] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:29 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:29.936304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:29.965120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc1c01-579c-4b6d-9477-65a9a3e2b13d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.044005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee86c19-8c84-4353-8884-3496248a43ee admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.049088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.050124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.050656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.051119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.052099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.052591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.054547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.075901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 284/567] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.078732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.095130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.096683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.097206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.099459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.101421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9521c-4d54-4147-8db2-8071255c8aa1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.113709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.115050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.117513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.118137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.123579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.129897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.134240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.137513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.156026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-82b4a2e3-8436-4671-b833-74c2194df41b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:30.158014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 284/568] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.159663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4635e-2363-4305-a547-69f64a3c9007 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.160052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:30.160359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4635e-2363-4305-a547-69f64a3c9007 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.160834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4635e-2363-4305-a547-69f64a3c9007 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.166228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 285/569] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:30.167630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.168668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 285/570] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:30 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:30.170232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4635e-2363-4305-a547-69f64a3c9007 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.182186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576b1f-e1a0-43e5-b495-a51f650b4055 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.185142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4635e-2363-4305-a547-69f64a3c9007 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.188356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.189048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.189318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.189592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.190565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.190884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.192008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.192589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a715-be96-45c5-a3a1-c6cb4e9149ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.193136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.193610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.194095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.195074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.195505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.197499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.209297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 286/571] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:30.210869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.211254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.211620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.215367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 286/572] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.217908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.232162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34ccfa-c0e1-4128-974e-3a348a560d0a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.238051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.238954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.239221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.239492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.242746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:30.243944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:30.250824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.251817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 287/573] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:30.252797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.253916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.263812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f860b7-442c-4008-9911-f67b1a9f96f0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.268354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.268499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 23 11:46:30.269261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.269540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.269951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 287/574] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.270052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/049a0120570d4d6e94d4d10a7460226d/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.276653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.285720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=049a0120570d4d6e94d4d10a7460226d, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.288455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.288566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef733db-128b-4537-b9dd-e6dd673fdfa5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.294295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.295322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.295674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.295954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.297210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.297539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.300511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.304763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 288/575] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:30 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/049a0120570d4d6e94d4d10a7460226d/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:30.305864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.359228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 288/576] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.366950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.385924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b90369-4d21-44b5-bc53-c26ad49d9dfa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.445213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a2f5-9288-4c9a-9ab3-ed1e9aeb29ce admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.451452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.452277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.452561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.452837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.469347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:30.474324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.475466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.475892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.476388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.476623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-30bb7a0f-75b4-46e3-b7bf-cc7d52d545b5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:30.477899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 289/577] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.479529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95028-f925-4bf5-9661-c1c713dd01e7 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.479812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95028-f925-4bf5-9661-c1c713dd01e7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.480090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95028-f925-4bf5-9661-c1c713dd01e7 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.486635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 290/578] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:30.487929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d95028-f925-4bf5-9661-c1c713dd01e7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.492940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.494986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.505354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d95028-f925-4bf5-9661-c1c713dd01e7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.510451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.511489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.511938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.512373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.514165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.514635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-42b61990-1e6b-4f05-8453-8362d281a621 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:30.514825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.516390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 289/579] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:30.516859 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.517895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.518273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.518686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.529986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 291/580] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.531414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.538403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:30.539812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:30.545306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c2a8-45bf-4217-9076-283a78f74178 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.548113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 290/581] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:30.549054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.550967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.551855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.552262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.552659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.553686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.554158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.556130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.569987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815eef-5834-426a-8d28-69e3acc7562c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.571241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 292/582] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.578876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.584108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.585570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.585570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.585570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.594950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b9a35-da81-4e67-9f77-d20bdf44359d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.598117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.600487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.602637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.603532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.603807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.604086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.616376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.618300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.621566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:30.623725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 291/583] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.624419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.633395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:30.634879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 293/584] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.634998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7487d-f3c0-4320-be5e-c8adc081f535 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.635449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.639840 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.640758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.641135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.641506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.647124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0fdb-ecd8-4f97-b1cc-b1a79235ab57 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.651903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.652664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.652943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.653333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.653885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:30.654832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.655140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.656881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.661881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:30.663651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 292/585] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.664625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.670380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 294/586] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.679565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.680361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adbb5a-473a-45c2-9ec3-c13c00ca403c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.685089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.685923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.686343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.686782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.687744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.688194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.689846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860cc4d-7510-420c-ae03-13a92c9e8ac0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.690383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.694979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.695773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.696050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.696314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.705587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 293/587] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.706671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.711376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.714222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.717186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8504-aa1d-4ab6-b920-c49a26ed8823 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.721978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.722875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.723388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.723800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.724749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.725193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.727060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.730345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 23 11:46:30.734589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 295/588] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.735556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.745340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 294/589] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.750873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.751014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c21436-f82e-4254-ba04-04a320d084cb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.757954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.759098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.759565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.759975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/16cff1dd38b24c53b75703647fddd213/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.761076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142c905-01f5-4d34-b827-ce5523591d9e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.766941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.767759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.768135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.768474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.769552 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.769926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.772441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.779769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=16cff1dd38b24c53b75703647fddd213, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.782826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.793388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 295/590] 10.222.0.65 () {56 vars in 1160 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:30.799134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.800760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 296/591] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:30 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/16cff1dd38b24c53b75703647fddd213/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:30.801876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.815746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fb9d-4e9a-46d0-9d16-975041c75392 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.876771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ed406-4364-4eed-a057-1748ff38a03d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.882735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.883806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.884228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.884938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.897724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.900070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.921907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:30.924226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 297/592] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.932686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:30.948366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.949302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.949687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.950106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.954200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91571-a21a-4a82-a9a8-d64acfa7ca84 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:30.961786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.964017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.971346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:30.972464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:30.972464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:30.972677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:30.973319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:30.973626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:30.975289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:30.983922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:30.985707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 296/593] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:30.993139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.006122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 298/594] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:31.009199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.021652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4a95-213a-4195-b97e-3797eb618e73 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.029650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c533-6d76-4870-a938-f4411259d6f3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.031076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.032981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.033362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.034235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.035514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.036933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.040194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.040980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.042956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.044264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.044638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.059488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.061825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.063158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 297/595] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:31.068991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.079889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e157040-0d47-459e-acb2-f7bcc6d045dc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.084866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.085717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.086179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.086432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.090351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:31.095512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.097628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.098965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 299/596] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:31.108247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.129120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84f800-5375-47db-9691-c2f4bafb035b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.130867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:31.133035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 298/597] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:31.135945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.136633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.136916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.137188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.138281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.138612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.140842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.146934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.152179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5745e5-697a-47c8-a793-aa49d6dd4fdb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.158309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.159387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.159865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.160365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.161414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 300/598] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:31.161720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.162272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.164443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.169163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.185422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5bb0d-dae1-4c96-973c-949d15a36640 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.190097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.191109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.191428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.191697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/ec66b04133444ff889865e3943181507/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.192111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 299/599] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:31.201789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.213576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=ec66b04133444ff889865e3943181507, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.214025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6b8e7-7c03-413b-a364-7834e122c600 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.216879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.219430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.220628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.221104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.221986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.231174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.233257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.233401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 301/600] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:31 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/ec66b04133444ff889865e3943181507/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:31.244197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 300/601] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:46:31.250757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.326246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119213f4-db7e-46ed-9a3b-0158c226157d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.331352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.332452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.332979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.333400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.345518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.347765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.368674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:31.370558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 302/602] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:31.376885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.386993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ffdcb-25a4-4af3-b45d-b76addeb32d6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.391994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.392885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.393311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.393724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.394634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.395095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.396947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.414815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 301/603] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:31.417002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.430994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b4f66-396d-496d-bf4e-5e0eef397342 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.438367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.439583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.440011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.440506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.451874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.453871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.474764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:31.476299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 303/604] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:31.482960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.496784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e54d-a43e-4fd4-b101-e29f1b012b4c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.508342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.509355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.509777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.510201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.511200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.511679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.513910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9164f8-f6d8-4a0e-a1cd-5cfd223a9e36 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.538972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 302/605] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:31.541964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:31.555713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e44b2d-3028-459e-a0ce-7ebc26186c50 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:31.560682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:31.561479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:31.561850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:31.562232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:31.563294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=b2b3428dc311404ba2f0dffa002d5ed0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:31.563709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:31.565655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6009ce-895c-44ed-a9de-0569619e77f9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:31.572420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 304/606] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:31 2021] GET /identity/v3/role_assignments?user.id=b2b3428dc311404ba2f0dffa002d5ed0&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.068916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ef52-c101-43ec-bb40-5dc62b07cf3a None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.069564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ef52-c101-43ec-bb40-5dc62b07cf3a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.069564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63ef52-c101-43ec-bb40-5dc62b07cf3a None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.071551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 303/607] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:33.077522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.078104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.078104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.092026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188c62-8292-4d02-af2e-20ff5f073404 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.092313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188c62-8292-4d02-af2e-20ff5f073404 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.092567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188c62-8292-4d02-af2e-20ff5f073404 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.094493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 304/608] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:33.099939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.100950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.100950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.104726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:33.105925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:33.121031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:33.122270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:33.124170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 305/609] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:33.130122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 305/610] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:33.155032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.164550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fe5ae-97e9-4647-b86b-0a94e94d360e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.166716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.177100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e34533-c17e-4415-a1ca-59d2fb8fc12e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.180980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.181792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.182070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.182344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.186984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.187786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.188059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.188329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.209902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:33.216930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:33.218364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 306/611] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:33.225624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:33.232708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:33.234261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 306/612] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:33.243604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.243831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.254345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b120da-23cd-4212-9d46-83bd6476b38a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.258882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.259534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.259809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.259975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e550c9-2a15-4e74-a721-9736e8cef483 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.260161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.260819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.261221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.262957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.272366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 307/613] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:33.272673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.273374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.273656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.273932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.280137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.280137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.280137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.290086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.291369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 307/614] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:33.305848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fc9b-4f61-41ec-92f8-6e19ca04031e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.308657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.311512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.312567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.313033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.313490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.326563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de929e-8a64-4b37-870a-19a4380aadde admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.333873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.335204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.336239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.338366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.338895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.339392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.361067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.363279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.378263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:33.379715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 308/615] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:33.385768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.396188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:33.407299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2393b-db06-43b5-9cbd-12598faa6311 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.409512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 308/616] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:33.411196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.420061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.420729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.421002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.421268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.422030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.422307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.424028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.425972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4c768-9f05-4d35-8676-354a5c6564e7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.436687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.437112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 309/617] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:33.437914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.438195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.438466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.439248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.439578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.441157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.448644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.459108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0dd6-ae8b-4fa2-8d6c-e02fa462a820 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.473869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 309/618] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:33.474889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.475151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.476155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.476670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.477126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.487583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.489990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.496056 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4f43-9232-483b-a1b8-c5eea5cc93e1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.507113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.508431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.508928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.509819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.519603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 23 11:46:33.526101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 310/619] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/users/glance => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:33.531259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.532584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.534685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.550477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922aec-8735-4c91-ac87-dd86d0467e58 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.558188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:33.562607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.563283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.563563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.563833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.564687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.564992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.566883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.569787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 310/620] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:33.581130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.597015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4785bd2-9841-4b96-880b-3acfe1f12fd1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.601708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 311/621] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.609746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.610435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.610749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.611021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.611877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.612185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.614071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.618248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.629228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337a494-fad7-48d5-a0d3-995d167c2a8b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.633790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.634447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.634757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.635030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.643573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.645338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.654979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 311/622] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.663641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.664301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 312/623] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:33.674866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.675843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b821-0a51-4789-8763-70fcef71702c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.684204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242e5c6-c21a-4432-bb74-5028d7e61e1a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.687194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.687873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.688156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.688428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.688641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.689615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.689897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.690167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.697106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.701425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.703420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.707072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.717026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 312/624] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:33.724469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.726199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:33.727724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 313/625] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:33.741383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f51363-8282-4a82-b2aa-3624b80c0936 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.743743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.753995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.754881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.755165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.755434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.767382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.769090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ba83-fd7e-40a3-b6ea-c720ab3d9de8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.769335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.789147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:33.791264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.791950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.792248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.792498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.793269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.793587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.794976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 313/626] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:33.795356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.797175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.807421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd457-bd83-4a82-93ed-00d91d026855 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.812668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.813394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.813674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.813945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.814773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.815075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.816768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.821086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 314/627] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:33.828796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.835453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 314/628] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.841521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.851570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e911a-d523-4c57-a2ce-412145ba2a73 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.851984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bf33-81a9-4870-87ef-3111b2566720 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.858531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.858531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.858531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.858531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.865812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.868277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.869114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.870158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.870684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.871165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.881580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.882945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:33.884091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.884194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 315/629] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:33.890419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.906549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95cc9e-aa5d-4ee4-a073-0fba1f8fc59d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.910724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.911451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.911729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.911997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.913487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.913791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.914410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:33.916598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 315/630] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:33.917588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.931066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.943405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45657-5698-48be-a2e2-2b91c99fe7e3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.947433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 316/631] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.950456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.955593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.955926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.956206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.957041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.957404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.959465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:33.964161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.981155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110e599-0af5-4d09-8237-86fa89d7735b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:33.981788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 316/632] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:33.988568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:33.994782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:33.996354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:33.997081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:33.997934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:33.999021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:33.999548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:33.999810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0e47-fed2-4004-954b-304ba0ca57b4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.001786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a89e49-e12b-4c86-8146-442e4ea6acac admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.009949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.009949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.009949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.009949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.010283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=049a0120570d4d6e94d4d10a7460226d) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.010283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.010283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739a35b-9860-44ef-a046-46e2d583a27b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.016715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 317/633] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/role_assignments?user.id=049a0120570d4d6e94d4d10a7460226d&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:34.017235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 317/634] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:33 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:34.053602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674856c-146f-4e5f-8d93-a33edd7cf077 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.053924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674856c-146f-4e5f-8d93-a33edd7cf077 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.054161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674856c-146f-4e5f-8d93-a33edd7cf077 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.056400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 318/635] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:34.066865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.067535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.068010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.111844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:34.114052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:34.136169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 318/636] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:34.185354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674856c-146f-4e5f-8d93-a33edd7cf077 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.206214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674856c-146f-4e5f-8d93-a33edd7cf077 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.213735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.214709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.214991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.215267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.236254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:34.243731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8995802e-e755-45e5-9f54-45bff045f031 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:34.245326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 319/637] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.252290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.268332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71cab9-fd08-4589-94f2-e2c5c3cfa9a3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.284144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.285228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.285710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.286202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.287250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.287764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.289636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.292925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6fb9b-0b77-47d4-a81b-b6d29faa46bf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.293208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6fb9b-0b77-47d4-a81b-b6d29faa46bf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.293478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6fb9b-0b77-47d4-a81b-b6d29faa46bf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.297127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 320/638] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:34.302341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.302740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.302865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 319/639] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.302950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.309656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.321042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29cc2-117d-4f03-ab30-047cd78d4d93 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.323799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:34.325492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:34.326016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.326918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.327199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.327475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.333872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 321/640] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:34.343024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.344992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.366044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.372643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.374321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 320/641] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:34.375889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498cc72-c939-4ab3-a5d0-0767550174ae None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.381028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.382352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.383307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.383585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.383858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.395895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b5295-0831-4539-b5b3-36fa05adbd21 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.402720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:34.404799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.405506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.405811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.406056 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.406873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.407146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.408736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113958-0056-4143-b6c2-134a811ca6c0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.410789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-389d3f1b-ae53-4620-809e-0dabff01bf99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:34.412372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 322/642] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:34.413756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681bded-470c-444a-a4dd-c5790107a05c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.414031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681bded-470c-444a-a4dd-c5790107a05c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.414298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681bded-470c-444a-a4dd-c5790107a05c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.416357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 323/643] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:34.419504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681bded-470c-444a-a4dd-c5790107a05c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.424432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 321/644] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:34.425838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.426118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.426384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.437671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681bded-470c-444a-a4dd-c5790107a05c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.443036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.443972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.444395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.444806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.445711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.446154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.447516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:34.448697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:34.449189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.459949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 322/646] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:34.460236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 324/646] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.460866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.466495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.470862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455e9bf-1395-4aef-a344-e78ed7bf523c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.475520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.476356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.476532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bc194-e7c3-4cd6-a950-627ea116a840 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.476620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.476883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.482346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.483166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.483445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.483722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.484716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.486750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.495530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.497509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.503476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 23 11:46:34.504856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 323/647] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.505538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.516282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9afed-fac0-448b-bcc5-fe9b50c51051 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.522564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.523996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 325/648] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.524416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.526013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.526873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.527149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.527511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.538864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbe1b-8133-4d4e-9d88-1d636b4a217e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.545469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:34.546499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.547601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.548069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.548548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.549705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.550252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.552482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.552588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:34.554065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 324/649] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.554933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.565931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91942e-c934-4e9a-b91c-3e13d0569c73 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.570497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.571179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.571461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.571733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.572466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.572771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.574357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.579797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 326/650] 10.222.0.65 () {56 vars in 1158 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.585640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.592412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 325/651] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.597467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.603988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcc16-ff6c-4dbd-88df-392248508f9b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.606955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec4106-1d9a-4835-990d-6901630f8255 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.609331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.610000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.610278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.610574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.611433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.611711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.613185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.613318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.614297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.615015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.616265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.623524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 327/652] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.624173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.627980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.630683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.633776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a1dcd-b6f1-412e-bf3d-7d44982c90db admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.639485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.640314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.640591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.640863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.643493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 326/653] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:34.650221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.650367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.652412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.661869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0261d1f-07b2-4172-9758-33f308b3a2ab admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.667112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.668088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 23 11:46:34.668499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.669065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.669569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.669832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 328/654] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.670902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.681414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539421d-0ec6-4f96-994b-22cb5f3c5f49 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.683719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.686373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.686880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.687701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.687977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.688244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.699073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.704075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.708870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.710659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 327/655] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.711650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.723069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.723715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d34f3-3541-4707-8a9c-dcef703c325a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.726629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 329/656] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.726629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.733688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.734383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.734693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.734962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.735817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.736361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.738848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.741941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea368cbc-8320-4130-8d81-2f4268312f39 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.746957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.748587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.749088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.749606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.750644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.751144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.753061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.758993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 328/657] 10.222.0.65 () {56 vars in 1160 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.759612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.767558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 330/658] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.768744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.770461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a4d8d-8cc5-41b7-a353-8cfa4c6f4d89 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.775521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.776787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.777089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.777362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.778983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.779210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.780917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.781952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100b782-e340-4ba0-8a9c-23babf4bb9d1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.789020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.790324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.790851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.791398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.793497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 329/659] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.794407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.804862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.807908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.810457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c9ad3-1caa-4485-ba31-d6a5fd5a0e9e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.815605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.816726 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.817216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.817397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 331/660] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:34.817957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.818142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.827669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.828613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322f4ac-bb99-4716-82e5-0ef3174e5505 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.830168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.833971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.834850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.835133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.835417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.843168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.845122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.846703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:34.848224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 330/661] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.849420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.860152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbb610-0926-4f5f-bb11-dbae6b28f84e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.860373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:34.861532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 332/662] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.862298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.876564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.877410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.877707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.877972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.878828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8ad9-cd2b-49c9-9c7d-404053c512d6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.883638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.884613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.885132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.885668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.886737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.887352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.889838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.891105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.893998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.909599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 333/663] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.910786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.912887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.914184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 331/664] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.914993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.922080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c358658-e7e7-4115-a7c3-e9a439d0a3e3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.926956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4526a7-7705-469b-9084-7b93756c48e3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.927296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.928279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.928751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.929212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.930196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.930732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.931543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.932378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.932696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.932986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.933666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.946207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.947569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 334/665] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.948160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.948790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.963377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48212677-0d48-4f19-8c2b-f3662ff9d153 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.969133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.970041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.970554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.971050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.971983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:34.972503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:34.974305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:34.976883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:34.979079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 332/666] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:34.979925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.988779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 335/667] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:34.990048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:34.991950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878660e-cd80-494a-8d5d-3ebf456a388f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:34.996969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:34.998254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:34.998612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:34.998881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:34.999930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=16cff1dd38b24c53b75703647fddd213) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:35.000277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.002296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.002757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6381cd-7521-4d9b-9729-ae2c143e5d00 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.008485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.009421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.009982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.010105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 333/668] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/role_assignments?user.id=16cff1dd38b24c53b75703647fddd213&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:35.010631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.011692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:35.012195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.014321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.017246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.028309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 336/669] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:35.034581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.036504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c475b3-2d6f-4cc7-9e3a-31e8901bbe3b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.047916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5fad5-a072-484e-ae92-0587ae1a8466 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.053063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.054290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.054827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.055316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.059313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.064389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.065005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.065483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.069076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.072291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.079283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.082359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.099923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:35.101951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 334/670] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:35.102571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:35.103967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 337/671] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:35.107891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.110759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.120363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5358-7d89-4fd1-901e-b61cf92cbb64 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.125634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefd7ae-06f9-4c48-96c6-dbf6885d4bf6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.125961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.126967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.127460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.127933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.128981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:35.129498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.131686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.137294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.138191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.138476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.143603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.147155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:35.147747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.149927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.150220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 335/672] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:35.156467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.169970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 338/673] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:35.173820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144ad6f-d5b4-463a-a576-b03d02e1fd2d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.176325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:35.187347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf9b45-934c-4002-ab2b-9495e62619d8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:35.190570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.191242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.191522 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.191798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.192759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=ec66b04133444ff889865e3943181507) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:35.193068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.195011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242294c-f2c4-4c32-9504-9125263fd947 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.199251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:35.200228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:35.200510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:35.200789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/b2b3428dc311404ba2f0dffa002d5ed0/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:35.205346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 336/674] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:35 2021] GET /identity/v3/role_assignments?user.id=ec66b04133444ff889865e3943181507&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:35.221631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=b2b3428dc311404ba2f0dffa002d5ed0, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:35.224479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a414a-4e3d-4446-84c4-5a1a28a77cf7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:35.242867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 339/675] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:35 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/b2b3428dc311404ba2f0dffa002d5ed0/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:46:36.950328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3254-034b-4e74-8801-2c276b7302c0 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:36.950953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3254-034b-4e74-8801-2c276b7302c0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:36.951244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c3254-034b-4e74-8801-2c276b7302c0 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:36.953547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 337/676] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:36.959529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:36.960007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:36.960105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:36.984697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:36.985920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:37.017031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc53c3-a544-47aa-a590-dd66282f87da None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.017650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc53c3-a544-47aa-a590-dd66282f87da None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.018143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc53c3-a544-47aa-a590-dd66282f87da None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.020604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 338/677] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:37.026588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.027207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.027699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.049653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 340/678] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:37.071496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:37.072906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:37.086312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 339/679] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:37.094850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.104018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20336535-1285-41da-aea0-011eb0d3cbbf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.111816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.117478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.118953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.119239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.119804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.121675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612f0f6-0d10-44fe-ac1c-2bf0cc2056cd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.126404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.127236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.127509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.127770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.142070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:37.149038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:37.151332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.153261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.156077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 341/680] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:37.156892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.177534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:37.178939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 340/681] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:37.185063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565aee2-eb49-4888-9706-7fc405bb38fa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.185277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.195369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54db08-d4f2-4e23-9ca6-f643d50b4849 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.197914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.198655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.198939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.199297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.199818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.200121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.200556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.200656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.200965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.201167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.201891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.202136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.202232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.203770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.220146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 341/682] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:37.221344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 342/683] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:37.227274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.228991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.246320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a4d1-f927-4e75-ace5-6493f20fc0dc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.251121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede5eb-63fd-4b9c-b2d0-fb92454816ea admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.256420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.258569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.258854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.259128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.260700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.261369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.261640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.261904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.262820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.264948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.283456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.285315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.302845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 343/684] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:46:37 2021] POST /identity/v3/users => generated 254 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:37.310266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:37.311810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 342/685] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:37.317885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.328795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8940a37-7a26-4a00-80e9-104fb736e82b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.333534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.334284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.334579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.334859 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.335659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.335962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.337604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.358731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 344/686] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:37.367949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.379714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88690b2d-20d4-4871-a519-4ef01e9b70ea admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.386781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.387803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.388080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.388350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.401927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.404290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.429353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:37.430654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 343/687] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:37.437083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.447655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dff58b-b72f-4e07-b896-82c4248ddb78 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.452587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.453202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.453588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.453858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.454744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.455049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.456910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.478186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 345/688] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:37.484177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.500559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802d5c-c221-4c7e-8935-a2397dbacc33 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.505277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.505940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.506287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.506577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.520713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.522499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.536677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 344/689] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 11:46:37.542977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.555976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f84c3-1651-4e77-9d7e-5d939935f22d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.560661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.561473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.561745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.562107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.576736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.578635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.597369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:37.599045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 346/690] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:37.605111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.618591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b91ab2-9329-4080-8b4c-072310caa942 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.625230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.626376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.626912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.627397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.628378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.628893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.630794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.650412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 345/691] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:37.658783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.669482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9322-1ae2-4e19-b9b2-55ddb9573640 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.675607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.676734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.677206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.677667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.685861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.688260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.703402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:37.705242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 347/692] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:37.711575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.722949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896d6b9-45ff-45f8-a0a5-eebd1a7378b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.728142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.729140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.729614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.730120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.731223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.731741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.733874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d192c-2781-4894-898c-7ea7e698fbef admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.747906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 346/693] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:37.754723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:37.766224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8a4c4-9f31-4795-ac7a-bd3d93dc593a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:37.771238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:37.772217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:37.772740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:37.773202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:37.774321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:37.774920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:37.777036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de4843-c65d-413a-8890-d736e5421085 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:37.784351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 348/694] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:37 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.103048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d651fd-e260-45a0-8427-f0609c84d302 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.104109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d651fd-e260-45a0-8427-f0609c84d302 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.104605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d651fd-e260-45a0-8427-f0609c84d302 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.107074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 347/695] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:38.113127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5850-860f-4607-92e7-99e5a3b37898 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.113993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5850-860f-4607-92e7-99e5a3b37898 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.114483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5850-860f-4607-92e7-99e5a3b37898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.139507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-37cb5850-860f-4607-92e7-99e5a3b37898 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:38.141074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-37cb5850-860f-4607-92e7-99e5a3b37898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:38.149104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 349/696] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:38.189723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d651fd-e260-45a0-8427-f0609c84d302 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.205747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d651fd-e260-45a0-8427-f0609c84d302 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.211896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.212967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.213469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.213946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.228962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:38.236671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:38.238214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 348/697] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.243794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066aa9-00a2-438b-bad5-71161e0d47b0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.244379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066aa9-00a2-438b-bad5-71161e0d47b0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.244887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066aa9-00a2-438b-bad5-71161e0d47b0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.247053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 350/698] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:38.248241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.253286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.253537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.253811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.272920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e7f9-e754-48fe-ba49-ea848487a7ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.282363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.283445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.283933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.284440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.286362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.288238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.290086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.292189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:38.295605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:38.308486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 349/699] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.314880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.316637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 351/700] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 23 11:46:38.332985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0560ae-9ee8-4867-861d-8c9356bdac2c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.337849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.338732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.339013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.339285 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.340316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.352483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1456b-a131-483e-b2e1-480e571bb554 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.356511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.356511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.374749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.376823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.377102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.377368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.379041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.381806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:38.381806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:38.381806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:38.382768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.384134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:38.389584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 350/701] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:38.396178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.414862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72105-face-4ce1-b845-7355e3674bf2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.416013 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 23 11:46:38.419239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 352/702] 10.222.0.65 () {56 vars in 1150 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.421171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.421864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.422144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.422410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.423247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.423550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.425594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.432675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524f0e-6f73-4d79-9f31-b409c12d4f63 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.439609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ca1a1-0756-46d3-beb0-6c90293a7b30 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.444189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.444898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.445186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.445463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.446209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.446530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.447556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:38.447556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:38.447556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:38.448435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c05ff-acf6-4822-b8af-382633d1af03 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.449917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 351/703] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.451702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9712-bc6d-45a1-98f4-96e191bfc40c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.451984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9712-bc6d-45a1-98f4-96e191bfc40c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.452256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9712-bc6d-45a1-98f4-96e191bfc40c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.454176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 352/704] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:38.458144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e9712-bc6d-45a1-98f4-96e191bfc40c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.461001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 353/705] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:38.462909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.463205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.463487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.473926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e9712-bc6d-45a1-98f4-96e191bfc40c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.479364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.480226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.480590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.480861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.481821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:38.482993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:38.490651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.492930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.498832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 354/706] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:38.499754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.507319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:38.509492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 353/707] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.512673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439a94f-7f47-4816-b96b-b677b30375ed None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.520170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.521349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.522009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.522289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.522640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.523372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.523682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.525297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.535044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e07bb-f354-44c0-ac1f-c49d814c25a1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.537738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 355/708] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.538763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.540228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.541142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.541611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.542066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.543230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.543803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.545919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.550781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df461-b837-4c7b-8369-018adfa1b8f2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.567467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.568632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.569136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.569683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.570634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.572512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.579972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 354/709] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:38.586220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.599316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 23 11:46:38.602138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 356/710] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services/network => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.606115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c630-7e16-4a6a-92a9-5f7a9697e44d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.608899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.619712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.620751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.622555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.623101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.626408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e83320-527f-42b7-bece-3acb69a267a2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.638690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.639673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.639913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.640403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.640893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.641469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.642056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] RBAC: Adding query filter params (name=network) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.642605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.644441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.650173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 357/711] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services?name=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.660516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 355/712] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:38.661904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.671605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.673310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb062a7-cc25-4e6e-ba96-95fb41188e2d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.679081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.679854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.680082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.680425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.681168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] RBAC: Adding query filter params (type=network) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.681472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.683243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.683496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c538-fa42-4bcb-b3e3-698230a88db3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.689276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.690450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.691145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.691738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.694773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 358/713] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/services?type=network => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.705793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.708260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.732347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:38.734383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 356/714] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.740955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.759609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1279f5-4032-4350-b17b-6b4f3729b5da admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.769348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.770037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.770315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.770637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.771365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.771668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.773294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.797356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 359/715] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.803818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.815418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5ed7d-616b-4892-b865-39f1f13f34cf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.826210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.827504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.827992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.828486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.837969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.842607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.857584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:38.859642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 357/716] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:38.865917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.881001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948ef85-c852-436b-94bb-1d91dc309314 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.886849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.887621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.888639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.888935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.889826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.890139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.892071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544f9f8-4b10-45b6-938e-82af942df638 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.907416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 360/717] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:38.914063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:38.933465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be6dc4-ae9e-4937-ba51-1601d23fb15b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:38.939173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:38.940240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:38.940716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:38.941187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:38.942294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=b2b3428dc311404ba2f0dffa002d5ed0) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:38.942877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:38.945065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12436-0495-49ff-b4d2-fa68779425e4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:38.953717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 358/718] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:38 2021] GET /identity/v3/role_assignments?user.id=b2b3428dc311404ba2f0dffa002d5ed0&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:40.554159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3a0c-0fb9-48b7-baef-620e137288fb None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.554709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3a0c-0fb9-48b7-baef-620e137288fb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.554709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f3a0c-0fb9-48b7-baef-620e137288fb None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.556818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 361/719] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:40.562664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.563126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.563199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.587544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:40.588741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:40.596781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 359/720] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:40.633642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f3a0c-0fb9-48b7-baef-620e137288fb None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.659055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f3a0c-0fb9-48b7-baef-620e137288fb None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.663352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.664158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.664435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.664705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.676417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:40.683476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-99533bbf-b987-4fa8-803b-77790a3a62c6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:40.685117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 362/721] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:40.691296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.700550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357e39-7a01-4266-9ff1-f9a9df6704fe None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.705141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.705818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.706094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.706367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.707167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:40.707472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.709074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.720169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31b34-be14-40e6-8522-fc517b4bbe04 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.720441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31b34-be14-40e6-8522-fc517b4bbe04 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.720716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31b34-be14-40e6-8522-fc517b4bbe04 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.722840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 363/722] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:40.723177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 360/723] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:40.729239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.729375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.729653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.729929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.739376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e56-70ff-423f-8d13-ce63f0884153 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.744405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.745362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.745785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.746223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.755595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:40.756816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:40.757966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.759966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.776824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:40.778633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 361/724] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:40.782746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 364/725] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:40.785113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.795339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471754a0-3678-4ff5-a08c-d206a5f4bd5d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.800435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.801335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.802087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.802566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.803485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:40.803957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.805722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.818875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 362/726] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:40.823790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.825320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.835788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6595e-3837-44fa-927c-c9eb8e8ebed5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.840903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.841996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.842153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42ed4-cecf-4409-b738-09967e50365a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.842636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.843077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.851494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.853904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.856427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.857266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.857549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.857837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.871266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:40.873371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 363/727] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:40.879498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.883592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:40.890801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:40.892303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 365/728] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:40.895513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dedde0-7797-428f-9a69-6d15c507f7ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.901949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.902660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.903048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.903322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.903576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.904278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:40.904582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.906406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.919082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf702ed6-940f-48cc-8031-60c2cec3371e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.931559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.932228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.932500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.932768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.933528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:40.933826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.935524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:40.940167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 364/729] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:40.946134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.956545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 366/730] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:40.962413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:40.964936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc799a-009a-476e-a24e-bbaf8d7f8a5b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.975849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.976503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.976777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.977045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.983165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845946e-b384-4f8c-943f-5ecf704d0fe2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:40.991552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:40.992547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:40.992824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:40.993091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:40.994709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:40.996457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.015080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 365/731] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:46:41.015899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.017808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.025503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.038040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723d8fa-a325-4530-87e3-fdfe60ba1913 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.041435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:41.042981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 367/732] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.048838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.059399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e315-a9a3-4d39-86db-f86f7850d90a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.060529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.061836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.062263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.062567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.064711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.065553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.065898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.066232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.067199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.067652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.069402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.083948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.085626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 368/733] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:41.086088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.089652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.105008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd9b9c-02ab-4b0f-b767-71499b29e260 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.112686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:41.114385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 366/734] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.120882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.127283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.128124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.128405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.128681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.131722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45cd60-38c1-41eb-abf5-ec97a4cc6cdf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.136414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.137189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.137439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.137746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.138110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.139022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.139421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.141288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.147664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.161460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 367/735] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:41.170167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:41.171865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 369/736] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.179614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.186589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.190626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67b952-4be3-4cc3-8c06-efbf83e27ed0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.199212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.200273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.201820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.202209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.203209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.204701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.206854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.209108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05106-4586-43c5-849a-df1548e0abda admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.220595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.221539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.221924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.222286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.231848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.233896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.249034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:41.250396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 368/737] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:41.250827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 370/738] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.259312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.261614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.273982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0e7c-d59a-4a5c-8865-498c670b139f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.274473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5cad7-2b8c-42f2-b1f4-3862055f03ec admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.283123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.284308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.284828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.285207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.286132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.287080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.287591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.287959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.288319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.288715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.291425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.313133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 371/739] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:41.315801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.317870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.319858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.337654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0bc80-3c4f-4294-ae5a-8490bde184a3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.347921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.349715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.350540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.351880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.352835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=95d72db4299b40cba45b3db1bc835939) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.355100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.358798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556faa6-ee26-4ce2-b0a5-4f89e1a1a6b2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.362539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-271c1cf9-9cac-4efa-8817-9285d3f4231d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:41.362539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 369/740] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.363112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd7572-d5b5-40c9-9251-5039cd691cae None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.364169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd7572-d5b5-40c9-9251-5039cd691cae None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.364634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd7572-d5b5-40c9-9251-5039cd691cae None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.374552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 372/741] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/role_assignments?user.id=95d72db4299b40cba45b3db1bc835939&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:41.375390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 370/742] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:41 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:41.378881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd7572-d5b5-40c9-9251-5039cd691cae None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.379155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.379443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.379718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.401248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:41.402629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:41.403773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd7572-d5b5-40c9-9251-5039cd691cae None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.411496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 373/743] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 23 11:46:41.413457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.414131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.414406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.414714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.415468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.415770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.417367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.443086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 371/744] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:41.449045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.463328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.463532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba09c3-c503-471a-a01e-6b324e31b1bf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.474687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.475506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.475777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.476041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.478856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278fccd-aa3c-49c9-9336-ae6c7e0b7148 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.488111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.490094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.493680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.494361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.494665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.494944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.495678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.496939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:41.496939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:41.496939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:41.497959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.521244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:41.523569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 374/745] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:41.530877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 372/746] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:46:41 2021] POST /identity/v3/services => generated 251 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:41.532005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.550787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e06d7-4b2d-4b4b-a63d-574d5a482e54 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.572390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.573938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.574503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.575285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.576384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:41.576937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.579290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea93c3-d5c9-492f-a5d9-a697e12a5dca admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.593820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 375/747] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:41.599751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.621404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d03d06-e5c0-406d-9f3b-d33194c9ba65 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.631457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.632385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.632659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.632953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.635095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=1a96bba0782248589ec206a1c8c9747e, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.637948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72344c-9823-418a-8d6f-c2e887cae077 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.661699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 373/748] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:41 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:41.754238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cb1-c3ab-4982-9366-e326f796e505 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.754954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cb1-c3ab-4982-9366-e326f796e505 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.755465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3597cb1-c3ab-4982-9366-e326f796e505 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.758009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 376/749] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:41.764346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e122-70a2-4dee-9db9-492ff1a1e9a4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.764664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e122-70a2-4dee-9db9-492ff1a1e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.764893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e122-70a2-4dee-9db9-492ff1a1e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.791289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f067e122-70a2-4dee-9db9-492ff1a1e9a4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:41.792700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f067e122-70a2-4dee-9db9-492ff1a1e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:41.860796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 374/750] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:41 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:41.885935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597cb1-c3ab-4982-9366-e326f796e505 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:41.900884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3597cb1-c3ab-4982-9366-e326f796e505 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:41.906062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:41.907287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:41.907782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:41.908261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:41.909304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:41.910773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:41.910773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:41.910773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:41.912236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d36a2-1547-4037-a014-5dec4114d31e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:41.933907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 377/751] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:46:41 2021] POST /identity/v3/services => generated 240 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:42.396639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a55b5-a62c-45ad-b88a-723fd5299dad None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.397263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a55b5-a62c-45ad-b88a-723fd5299dad None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.397751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a55b5-a62c-45ad-b88a-723fd5299dad None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.400067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 375/752] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:42.405851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.406406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.406932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.427914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:42.429433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:42.447213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 378/753] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:42 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:42.473340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a55b5-a62c-45ad-b88a-723fd5299dad None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.493391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a55b5-a62c-45ad-b88a-723fd5299dad None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.504121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.505277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.505759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.506251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.527438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:42.535657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:42.542266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 376/754] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:42.543611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.559902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e36a55-6d9a-4d57-997b-e0df5dee2a4e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.576459 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.577209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.577436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.577712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.578495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:42.578827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.580447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.597099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 379/755] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:42.603321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.619105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3e79-7880-48e1-9c76-e0042f7b1779 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.630821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.632045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.632532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.633000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.652697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.655192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.676556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:42.678141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 377/756] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:42.684495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.704081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b01ac3-f3da-4757-a7c7-9c649df37372 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.714722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.715422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.715713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.715991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.716741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:42.717046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.718680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.740534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 380/757] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:42.746585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.759611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676a8d9-bcfb-4acd-8441-76a4606b79d0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.766365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.767487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.767986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.768470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.783756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.786107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.803345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:42.805354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 378/758] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:42.811719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.828508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40f30b-f47d-49c1-a26d-dc88f7fae5e3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.837502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.838230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.838536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.838834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.839691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:42.839998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.842084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.870737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 381/759] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:42.877022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.892215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13591340-0e68-4f71-b685-71bc5fd10a81 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.902578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.903575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.904062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.904548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.922271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.924364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:42.936710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 379/760] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:46:42.942943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:42.955504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044557f-9bfc-4fce-8586-832560e32fc7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:42.963169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:42.963982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:42.964262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:42.964536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:42.975620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:42.977462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:43.000307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:43.001854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 382/761] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:43.007889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:43.017413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9051204-ec77-48ac-9433-9242fe460780 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:43.027525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:43.028261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:43.028543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:43.028817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:43.029566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:43.029871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:43.031499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:43.048899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 380/762] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:43.055157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:43.067683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba645f-cee0-4c12-807a-0eec4eeaf3ef admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:43.075938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:43.076757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:43.077031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:43.077297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:43.096097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:43.098152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:43.122969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:43.124458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 383/763] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:43.130706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:43.144005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dec2b-1c9e-4236-87a8-aa6fd4c12315 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:43.159782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:43.160469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:43.160748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:43.161019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:43.161833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:43.162136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:43.164065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796acb24-f4b2-4dd6-8938-e374ec13d9cc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:43.184911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 381/764] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:43.191710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:43.210111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765c46-faa8-4f7d-b481-142523755f72 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:43.223789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:43.224452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:43.224732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:43.225008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:43.225867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=b2b3428dc311404ba2f0dffa002d5ed0) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:43.226175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:43.228083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813dc7b-a99c-47be-be62-17516f3710df admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:43.239108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 384/765] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:43 2021] GET /identity/v3/role_assignments?user.id=b2b3428dc311404ba2f0dffa002d5ed0&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.421901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced927-df66-494e-9dc8-5042901e151d None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.422592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced927-df66-494e-9dc8-5042901e151d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.422592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ced927-df66-494e-9dc8-5042901e151d None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.424589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 382/766] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:44.430453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00643f60-73b3-4f95-a6ef-a6a3962947ed None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.430986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00643f60-73b3-4f95-a6ef-a6a3962947ed None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.431067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00643f60-73b3-4f95-a6ef-a6a3962947ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.455564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-00643f60-73b3-4f95-a6ef-a6a3962947ed None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:44.456767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-00643f60-73b3-4f95-a6ef-a6a3962947ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:44.464606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 385/767] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:44.471015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d2f0-67cb-4faa-98ee-65b42d7650dc None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.471298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d2f0-67cb-4faa-98ee-65b42d7650dc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.471573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d2f0-67cb-4faa-98ee-65b42d7650dc None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.473604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 383/768] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:44.479528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.479815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.480086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.494760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d2f0-67cb-4faa-98ee-65b42d7650dc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.502038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:44.503239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:44.514535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 386/769] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:44.516401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d2f0-67cb-4faa-98ee-65b42d7650dc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.527158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.528338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.528857 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.529352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.538539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.544651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:44.545858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043df6-3301-4e0f-9012-69da1e4be2b5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.550450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.551310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.551587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.551858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.553201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-ee393296-ce35-4092-aa08-0d256a789cb2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:44.554709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 384/770] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.556206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceeceb-4741-4d16-8751-f73bad25f607 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.556688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceeceb-4741-4d16-8751-f73bad25f607 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.557157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fceeceb-4741-4d16-8751-f73bad25f607 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.559142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 385/771] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:44.561937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceeceb-4741-4d16-8751-f73bad25f607 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.563331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:44.570958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c1223787-d130-42ef-9d51-b18581b52979 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:44.578535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 387/772] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:44.578535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.578535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.578535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.581604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fceeceb-4741-4d16-8751-f73bad25f607 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.586371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.587070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.587347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.587617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.588388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.588686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.590517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.594712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:44.595903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:44.599795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 386/773] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:44.600701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.604675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 388/774] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:44 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:44.606439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.617029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17f523-ac7a-45d4-9b9d-7a8765ba3d00 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.618669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e155-2e43-4895-94bd-8069666f6c74 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.621701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.622589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.623036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.623469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.632053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.632726 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.633003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.633270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.634035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.634341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.635957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.644153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.646281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.647051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 387/775] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.647670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.657324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033f34-8741-4e12-9112-f4e719571b58 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.661805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.662648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.662923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.663192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.663861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.664866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:44.664866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:44.664866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:44.665741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.666272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:44.668316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 389/776] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:44.669157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.680059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d272-5833-40ed-8580-4ccb731fe0fd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.684203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 23 11:46:44.684859 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.685647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.685881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 388/777] 10.222.0.65 () {56 vars in 1150 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.686046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.686597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.687666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.698646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.701437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.704497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceee2d6-5ecf-4be1-91f9-4a2ad271784c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.709226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.709879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.710204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.710478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.711460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.711758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.713391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.721209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:44.722885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 390/778] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.723675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.726270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 389/779] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.735437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.742118 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6dc2d-a7d7-4e52-b833-a800859f7d48 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.744608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802ac2f-4664-4e86-ad42-924ef37717c9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.747177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.748292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.748718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.749223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.749776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.750272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.750777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.750877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.751188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.751561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.753232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.758764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 391/780] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.760469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.763069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.764943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.774783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fc18-ed62-471f-871a-9c287cf36445 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.779576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.780315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.780508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:44.780750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.781088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.781935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.782303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.787695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.787821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 390/781] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.787821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.803234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e00d-868a-44f9-a15f-63db900ace1d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.810387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 392/782] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.810387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.816465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.817620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.818132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.818643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.819654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.820191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.821562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:44.821562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:44.821562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:44.821799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e30614-0879-4910-8fb2-1f4f72f66b06 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.823230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.827468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.828248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.828576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.829004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.829931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.830343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.832405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.834172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 391/783] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.835237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.849297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03976-fae6-43b1-acce-16ebe05382a7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.854044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.855139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.855637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.856193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.859689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 393/784] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.860431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.865537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.867919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.871169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41abb-2d1c-4a98-a683-e2932c9f61a7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.876423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.877201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.877417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.877664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.878547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] RBAC: Adding query filter params (interface=public, service_id=19ef01cc40034dba8f9690f9037423e1, region_id=RegionOne) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.878847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.879965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:44.879965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:44.879965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:44.880896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.886274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:46:44.892767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 394/786] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/endpoints?service_id=19ef01cc40034dba8f9690f9037423e1&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.892767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.893007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 392/786] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.896595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.906991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5db75-8db1-40c7-9c33-2cfd72e6ef9d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.908136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69e96c-24e9-4cd3-8aff-dede35e03bff admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.912812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.913057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.913678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.913956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.914261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.914713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.915153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:44.915422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.915520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.916047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.917550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.930994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.933251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.943133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 393/787] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.943133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.953186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a0696-4c33-491f-a01f-ede547595f2f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.957892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.958574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.958897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.959170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:44.959867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:44.961544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:44.965010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:44.966797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 395/788] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:44.967193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 394/789] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:44.968165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.972652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:44.978935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569eea7-7daf-4a16-ac3a-e563233ebbcf admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.985998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce1e14-2e63-474c-8d3b-f2aca352c597 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:44.991433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:44.992529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:44.993008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:44.993477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.006197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.007306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.007804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.008268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.009216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.009714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.011990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.013108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.015130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.044215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 396/790] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:46:45.045663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 395/791] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.047331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.052534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.065333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9acc7-9a77-4bb6-abb1-e0c1ac994d30 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.069407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8b34-4f80-47e3-ae20-e93fde9dc455 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.078233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.079977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.080822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.082219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.082776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.084381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.085038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.087112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.104034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.106545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.109104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.111807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.135124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:45.145689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 396/792] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:45.148692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:45.150236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 397/793] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:45.155624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.166077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dabb8-0a95-405f-898c-15bafbab3f21 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.169975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.181545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d065-e797-4964-8233-42d026ba5e2b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.184792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.186202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.187219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.188476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.190002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.190842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.191396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.192277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.194345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.194881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.195343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.196337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.197591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.199409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.216195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 397/794] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.220857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 398/795] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.223290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.232573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.236510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd872380-27c7-42b0-8875-3421d1b3dad9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.241683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.242614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.242900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.243310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/95d72db4299b40cba45b3db1bc835939/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.245909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1424a-0b62-40ef-b102-4cdfd9f4dcd5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.251600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.252759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.253290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.253797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.261048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=95d72db4299b40cba45b3db1bc835939, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.262027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.263875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dbd83-df5a-4c24-ab68-d320ed5ca5b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.264445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.278883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-73c25d23-333c-4de1-b782-528643aa9da4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:45.279165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 398/796] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:45 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/95d72db4299b40cba45b3db1bc835939/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:45.280462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313bfa-af31-4721-b877-3cfa4b525ebe None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.280738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313bfa-af31-4721-b877-3cfa4b525ebe None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.281015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc313bfa-af31-4721-b877-3cfa4b525ebe None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.282942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 399/797] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:45.283057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 399/798] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:45.286281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc313bfa-af31-4721-b877-3cfa4b525ebe None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.295228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.295843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.296370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.327057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:45.328389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:45.390364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc313bfa-af31-4721-b877-3cfa4b525ebe None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.400498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.401899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.404098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.404649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.410226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.410595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.412493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.446185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 400/799] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:45.453356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.467903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 400/800] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:45 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:45.468479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42ca20-2241-4044-ab69-10d6c1c5c23c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.479128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.479809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.480149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.480470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.481513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.481875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.483937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.491883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 401/801] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.510802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.521389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a823978-05e6-450d-96ce-08e3caf4caa1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.526467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.527416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.527698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.528008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.528714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.530490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.542850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 23 11:46:45.544790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 401/802] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:45.551641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.562788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf19f-bcb6-4171-a961-eb29ffd032f1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.567312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.568042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.568325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.568600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.569483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.569789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.571478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.577075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 402/803] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.583154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.593892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e4bf2-9df9-4ed8-a7cc-c6ae01136427 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.599036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.599738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.600069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.600346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.601091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.601456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.603265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.610012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 402/804] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.616929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.628299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9cc01-3d29-4810-b103-11154dd49781 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.633461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.634192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.634479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.634815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.635639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] RBAC: Adding query filter params (interface=public, service_id=1cb0f7242d37417d86f9b087ca6026ee, region_id=RegionOne) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:45.636000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.637035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:45.637035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:45.637035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:45.638568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471f5e-bd27-4a8b-8622-ea99626adc1f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.649743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 403/805] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/endpoints?service_id=1cb0f7242d37417d86f9b087ca6026ee&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:45.656156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:45.666814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c75a7-fe48-4df7-8b21-d5b440d69d11 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:45.672084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:45.672822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:45.673109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:45.673439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:45.674161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:45.675976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb13df0-c628-4110-b148-12b1a18b54a9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:45.682455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 403/806] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:46:45 2021] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.279713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc6b-e89c-463a-afd3-6f2009667348 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.280099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc6b-e89c-463a-afd3-6f2009667348 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.280271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2cc6b-e89c-463a-afd3-6f2009667348 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.282323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 404/807] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:46.288198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.288484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.288755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.312760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:46.313958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:46.322019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 404/808] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:46 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:46.345074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2cc6b-e89c-463a-afd3-6f2009667348 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.367836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2cc6b-e89c-463a-afd3-6f2009667348 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.372220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.373011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.373291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.373563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.384163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:46.391125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:46.392650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 405/809] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:46.398930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.408072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d3d3-c17d-4bf6-b23c-e948900b5021 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.412609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.413280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.413555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.413823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.414617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:46.414926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.416524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.425725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 405/810] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.431721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.446474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951dbb-3be9-4f01-9036-634373d06d21 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.451417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.452239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.452514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.452781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.464244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.466245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.482835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:46.484354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 406/811] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:46.490704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.501631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd79c-c501-4cb2-bd6b-6cbf20302779 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.507138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.507804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.508084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.508360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.509096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:46.509400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.511025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.524965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 406/812] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.531917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.542769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6e54-9b6c-4156-a483-c3831a3fb4cc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.548007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.548852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.549133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.549407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.559054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.561853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.576295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:46.577849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 407/813] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:46.583980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.595776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da968f4-cae4-4f54-9541-0128c7cded70 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.603884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.604636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.604913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.605223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.606811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:46.607144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.609084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.635638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 407/814] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.642466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.653254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e1288-9c85-4a88-a7ae-0809aea5c7cf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.662811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.663612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.663942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.664216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.680656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.682497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.704323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:46.705853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 408/815] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:46.712016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.723060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc2da7-cc49-47d8-af98-ed29a5e23a88 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.727567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.728240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.728520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.728792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.729534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:46.729839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.732224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.744913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 408/816] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.751588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.761364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84657-1a58-4093-b53e-44838054c907 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.766257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.767080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.767363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.767633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.779914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.781867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.801510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:46.802710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 409/817] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:46.808957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.823673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3fe6-c8da-4b75-a63e-98057a9665dd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.829269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.829938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.830219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.830490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.831319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:46.831628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.833513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0f2a2-e0f1-4471-a7f2-72155064c836 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.847354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 409/818] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:46.853825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:46.864345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed26d-dec6-4ebf-b4e9-1b182196792c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:46.869126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:46.870015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:46.870294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:46.870601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/b2b3428dc311404ba2f0dffa002d5ed0/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:46.873215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=b2b3428dc311404ba2f0dffa002d5ed0, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:46.875871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41781-117b-4818-9c73-5e78bb3a3685 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:46.899643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 410/819] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:46 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/b2b3428dc311404ba2f0dffa002d5ed0/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:48.037144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bfea-4981-4bfb-b362-7a1f013943b2 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.037866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bfea-4981-4bfb-b362-7a1f013943b2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.037866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bfea-4981-4bfb-b362-7a1f013943b2 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.039784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 410/820] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:48.045807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.046416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.046416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.075907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:48.077131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:48.159472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 411/821] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:48.195615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880bfea-4981-4bfb-b362-7a1f013943b2 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.220427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880bfea-4981-4bfb-b362-7a1f013943b2 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.232854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.232854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.232854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.232854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.235411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.235411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.243950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 23 11:46:48.245688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 411/822] 10.222.0.65 () {56 vars in 1150 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:48.252474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.268068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0cd3-4fef-4dc7-8165-1dc97d7c5a53 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.278554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.279420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.279697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.279967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.280693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.280991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.282600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.290845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 412/823] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.296699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.311711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ad75-54c0-4dd2-915c-5c921f41f221 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.322585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.323583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.324086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.324576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.325542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.326041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.327885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a903a-fb19-40ab-a15d-96688fd5eb5b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.334903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 412/824] 10.222.0.65 () {56 vars in 1145 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.341060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.364973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56791d0-5f81-4b57-9d44-989d8c761679 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.376662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.377335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.377616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.377894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.378699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.379714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:48.379714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:46:48.379714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:46:48.380594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7c5ee-ba11-4447-9efd-08edd390fa04 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.414295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 413/825] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/endpoints => generated 346 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:48.530735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8426-08ea-4e66-8aa6-d750952c032c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.531100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8426-08ea-4e66-8aa6-d750952c032c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.531304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a8426-08ea-4e66-8aa6-d750952c032c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.533541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 413/826] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:48.539936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.540268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.540491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.567933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:48.569100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:48.600092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 414/827] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:48.629523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a8426-08ea-4e66-8aa6-d750952c032c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.648749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a8426-08ea-4e66-8aa6-d750952c032c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.658924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.659785 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.660077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.660326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.661020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.662667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.678697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-fbf820a5-1027-418a-929c-12723df0576a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 23 11:46:48.680349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 414/828] 10.222.0.65 () {56 vars in 1153 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:48.686896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.700002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eea9d-b8e9-48cd-b688-e03432a53bf8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.711847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.712546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.712829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.713106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.713857 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.714167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.715883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.721234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83cd6-6f5f-45ce-9ad5-5bd349a45467 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.721519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83cd6-6f5f-45ce-9ad5-5bd349a45467 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.721823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83cd6-6f5f-45ce-9ad5-5bd349a45467 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.724036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 415/829] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:48.728987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 415/830] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.733063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab135-768c-425d-b078-33e18bfa8388 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.733340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab135-768c-425d-b078-33e18bfa8388 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.733598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aab135-768c-425d-b078-33e18bfa8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.737318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.748900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421551cc-927c-4722-bc20-e02131703866 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.755018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.756035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.756537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.757059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.757609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-90aab135-768c-425d-b078-33e18bfa8388 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:48.758190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.758740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.758858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-90aab135-768c-425d-b078-33e18bfa8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:48.760703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d79fe6-109c-4ed5-a1d1-18616f7223f0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.767062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 416/831] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.767605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 416/832] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:48.768937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172e54-3ab2-480e-8ae4-9f2bf6db224e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.769223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172e54-3ab2-480e-8ae4-9f2bf6db224e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.769499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e172e54-3ab2-480e-8ae4-9f2bf6db224e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.779860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 417/833] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:48 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:48.785969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.786286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.786570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.796113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e172e54-3ab2-480e-8ae4-9f2bf6db224e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.810969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e172e54-3ab2-480e-8ae4-9f2bf6db224e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.812239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:48.813716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:48.816812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.817257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.818227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.818227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.818818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.821474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.836465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 23 11:46:48.836835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 418/834] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:48.837030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 417/835] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:48.844041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.857044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc44a1-43eb-4fe9-b0cf-96f0e3a44007 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.862084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.869415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.870157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.870443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.870786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.871672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.872065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.874124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.874491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e011cf-a455-4385-b06a-25da8c1585b7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.879853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 419/836] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.887949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.888543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.888774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.889059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.889332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.900884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:48.901072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73975e-623c-49cf-aa48-a271816e4d7a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.906351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.907322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.907843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.908336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.908452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:46:48.909374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] RBAC: Adding query filter params (type=network) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.909892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.910005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 418/837] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:48.911833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.916265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.918389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 420/838] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.928875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.934561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78149393-cac0-428a-9fb2-43fe42b70b7c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.945604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.946338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.946668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.946945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.947792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:48.948099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.952852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f3e33-55f0-40e8-8f10-0e637f3b014a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:48.953533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.965571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:48.966351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:48.966661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:48.967028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:48.967807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:48.970814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:48.972953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 419/839] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:48.979197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:48.995301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02622d-fd96-47c6-8ed4-bba1af631056 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.000477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.001352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.001633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.001906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.004179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 421/840] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:46:48 2021] POST /identity/v3/endpoints => generated 327 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:49.022017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.024074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.050197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:49.053193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 420/841] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:49.059834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.083543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64c25-7299-4007-b259-5c37daf13803 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.088220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.088974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.089259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.089533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.090450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:49.090806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.092737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.106955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 422/842] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:49.113149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.124033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a810904-6f3e-4481-86cb-c3ff97b61c65 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.129147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.130045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.130327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.130723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.139671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.141714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.158557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:49.160270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 421/843] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:49.166757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.178882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d6db-92ea-4358-9947-b662c6ffcfeb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.184618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.185554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.185846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.186123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.187107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:49.187402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.189345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.209601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 423/844] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:49.215953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.228134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15b03-3bb4-426e-adbc-5c15e343d55d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.233625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.234616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.235102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.235383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.249169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.251133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.261618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 422/845] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:46:49.268099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.278434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae7e3-ff20-4e5b-a736-679d6bb672a6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.283492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.284326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.284667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.284945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.297298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.299205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.317599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:49.319183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 424/846] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:49.325669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.335113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cb149-90f3-4b51-a9cb-30d178aace0b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.339833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.340535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.340946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.341405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.342763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:49.343374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.345064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.364199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 423/847] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:49.371263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.383104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45022d5-f94d-4ae8-a9bd-839d9afda688 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.392469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.393585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.394054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.394474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.402535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.404967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.419900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:49.421611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 425/848] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:49.427960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.438895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5dd9b-778c-4965-aa29-a4063efe58fd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.443851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.444723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.445153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.445614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.446648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:49.447103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.449155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb18d-10e6-4611-b8cc-82ee375271e1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.464264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 424/849] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:49.471393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.482752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147df3-7f41-4662-adab-169bf58e0ce4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.488045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.489018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.489486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.489900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.491273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=95d72db4299b40cba45b3db1bc835939) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:49.491772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:49.493872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407addd-a1a8-4079-ad33-2399d25a48a6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:49.501678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 426/850] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/role_assignments?user.id=95d72db4299b40cba45b3db1bc835939&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:49.908979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c242-b8cd-4617-a980-91865cc702ee None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.908979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c242-b8cd-4617-a980-91865cc702ee None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.908979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c242-b8cd-4617-a980-91865cc702ee None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.909794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 425/851] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:49.916407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.917033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.917513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:49.936449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:49.938016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:49.946371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 427/852] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:49 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:49.971079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9c242-b8cd-4617-a980-91865cc702ee None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:49.984202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9c242-b8cd-4617-a980-91865cc702ee None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:49.989154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:49.990583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:49.991065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:49.991549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.003031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:50.010252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:46:50.012010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 426/853] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:50.018943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.028465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11bb61-1a9b-4da4-8f77-1207b804ed91 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.033283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.034229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.034735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.035228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.036194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.036695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.038542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.048155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 428/854] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:50.054637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.065509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a282aa6-b8fa-496b-9109-826b7e917e9e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.070339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.071459 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.071971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.072441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.084476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.086693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.104077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:50.106069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 427/855] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:50.112618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.123628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1807-2a1b-4069-b200-f919381d06a3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.128496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.129432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.129923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.130389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.131409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.131915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.133740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.148757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 429/856] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:50.155827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.167055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd163-c8a0-4bbe-93c5-2e857cfe2c4a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.172384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.173570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.174051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.174539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.183618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.186212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.200184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 23 11:46:50.202033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 428/857] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:50.208628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.219547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e56d9-5b29-4470-9fba-8bfc55df9e71 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.224364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.225281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.225770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.226253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.227316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.227818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.229858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.248397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 430/858] 10.222.0.65 () {56 vars in 1156 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:50.254897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.265438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c93e4-3d9f-4292-8b6f-6fc481605d16 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.270336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.271252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.271781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.272254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.281563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.283631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.293518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 429/859] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:46:50.300114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.310618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea416e-06e4-4a1c-8242-7eacb382a873 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.315608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.316691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.317204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.317676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.329402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.331624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.349642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:50.351648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 431/860] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:50.358954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.368872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e219d7-42b8-4f04-a595-0e946068419c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.373670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.374335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.374655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.374932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.375733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.376037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.377731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.391074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 430/861] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:50.397244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.407996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b7afa-22ba-4f13-86c6-bb07fb227bbe admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.412790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.413624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.413913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.414184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.421669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.423703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.437803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:50.439431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 432/862] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:50.445787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.456345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97531-1e6d-4a0e-8f53-fcba093ae227 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.461126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.461797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.462078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.462401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.463236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.463596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.465990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0c4c3-eb84-4431-966a-272bfbc8ec90 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.479092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 431/863] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:50.485738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:50.497083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda9fc3-7b99-4e56-a382-6d971733f24e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:50.501835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:50.502487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:50.502831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:50.503107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:50.504001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=b2b3428dc311404ba2f0dffa002d5ed0) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:50.504308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:50.506205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba128-1139-4d2c-b821-3709c00f06c9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:50.512492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 433/864] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:50 2021] GET /identity/v3/role_assignments?user.id=b2b3428dc311404ba2f0dffa002d5ed0&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:51.206634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce102696-379e-48e9-ac45-5fb2d8e72060 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.207387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce102696-379e-48e9-ac45-5fb2d8e72060 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.207387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce102696-379e-48e9-ac45-5fb2d8e72060 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.209217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 432/865] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:51.216568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.217407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.217407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.247719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:51.248936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:51.258956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 434/866] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:51 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:51.285205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce102696-379e-48e9-ac45-5fb2d8e72060 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:51.298983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce102696-379e-48e9-ac45-5fb2d8e72060 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:51.303809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:51.304627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.304904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.305176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.305857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:51.307674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:51.321813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 23 11:46:51.323492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 433/867] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:51 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:51.330140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:51.342090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3bb2-22a8-4c49-aa8c-8c70ffd7fa45 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:51.349882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:51.349882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.349882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.349882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.350664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:51.350664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:51.354542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adba1f-f900-4650-80b9-9aa0c3fdb268 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:51.359167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 435/868] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:51 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:51.363351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:51.381707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858348c-40c9-4eab-81fb-d09fee249157 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:51.386284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:51.387181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.387466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.387742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.388466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:51.388772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:51.390402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d9d8-8bf3-43d8-87f8-61d8f4aee32c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:51.396613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 434/869] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:51 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:51.405495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190153d-5a73-4421-8800-8940e9608d2c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.405809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190153d-5a73-4421-8800-8940e9608d2c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.406143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190153d-5a73-4421-8800-8940e9608d2c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.412810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 436/870] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:51.415178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c8de-090f-4ad8-bbaf-340df5ebe5c6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.415448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c8de-090f-4ad8-bbaf-340df5ebe5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.416025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c8de-090f-4ad8-bbaf-340df5ebe5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.436541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0c98c8de-090f-4ad8-bbaf-340df5ebe5c6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:51.437764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0c98c8de-090f-4ad8-bbaf-340df5ebe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:51.446565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 435/871] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:51 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:51.473738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190153d-5a73-4421-8800-8940e9608d2c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:51.487081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190153d-5a73-4421-8800-8940e9608d2c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:51.492667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:51.493346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:51.493618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:51.493886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:51.494688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:51.496319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c9297-8819-45c4-8a92-e15a13a4bfbe admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:51.515377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 437/872] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:46:51 2021] POST /identity/v3/services => generated 269 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:52.143005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a4d5-1427-4f35-ac83-92abb82c6caf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.143005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a4d5-1427-4f35-ac83-92abb82c6caf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.143005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a4d5-1427-4f35-ac83-92abb82c6caf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.143888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 436/873] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:52.149868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.150379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.150914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.170436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:52.172018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:52.193570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 438/874] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:52 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:52.217993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a4d5-1427-4f35-ac83-92abb82c6caf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.231442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a4d5-1427-4f35-ac83-92abb82c6caf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.236244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.237322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.237824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.238296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.249846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:52.257509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:46:52.259377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 437/875] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:52.266316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.276088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2521d4-1d15-464b-8560-622cda061d6a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.281484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.282551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.283080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.283579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.284583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.285090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.286986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.296843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 439/876] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:52.303380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.314189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537c28e-6cc5-4475-84d9-5dec22e25cc0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.319133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.320202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.320698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.321169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.333345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.335554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.364211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:52.366333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 438/877] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:52.377454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.382657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadec446-3366-46e0-a7e0-816bcb27b904 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.387492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.388504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.388966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.389382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.390273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.390763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.392578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.406278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 440/878] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:52.412603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.423266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe278b2-6f1c-4b77-9f0b-236415e3b4e1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.428146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.429192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.429677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.430094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.439589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.441917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.457343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:52.459188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 439/879] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:52.466068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.476247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f1c3-3172-497d-8ab8-324a5b31b514 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.481828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.482901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.483440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.484033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.485106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.485813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.488426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.509707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 441/880] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:52.516503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.527114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e3d5-4f5f-4419-81f4-bf502fed5c2e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.532150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.533073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.533506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.533922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.543485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.545576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.555724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 440/881] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:46:52.563942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.574234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23142-8c73-4f5f-bcb9-10becd59fa95 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.579019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.579887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.580161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.580484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.592132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.594067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.611581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:52.613317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 442/882] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:52.620028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.629869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a484-3a2a-4f02-9e86-d5516592e6b7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.634447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.635147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.635429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.635702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.636442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.636760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.638807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.652876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 441/883] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:52.659517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.670486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c7a3-2bbf-4f99-9b6d-4aa50a12334e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.675569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.676698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.677144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.677628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.686275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.688613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.703345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:52.705315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 443/884] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:52.712093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.723092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c731e5-1c55-4a52-b916-4714f9d25ea1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.728104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.729090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.729550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.730023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.731211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.731686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.733816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc690b5-fcb1-4c81-aebe-f0479ea81132 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.748727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 442/885] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:52.755625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:52.767333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1912c-41f8-4085-83e1-e53fef23d7ab admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:52.772356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:52.773279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:52.773765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:52.774205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:52.775365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] RBAC: Adding query filter params (role.id=bf26998ac0a849a88ff55d1e94d31e2b, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=95d72db4299b40cba45b3db1bc835939) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:52.775876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:52.778175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256412e3-6c0b-45dc-9738-efbabeb723b8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:52.784497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 444/886] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:52 2021] GET /identity/v3/role_assignments?user.id=95d72db4299b40cba45b3db1bc835939&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=bf26998ac0a849a88ff55d1e94d31e2b => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:53.119721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1cab-8771-4c08-ba88-f314dbecd41a None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.120104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1cab-8771-4c08-ba88-f314dbecd41a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.120279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d1cab-8771-4c08-ba88-f314dbecd41a None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.122300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 443/887] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:53.128509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.129073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.129551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.148200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:53.149749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:53.158347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 445/888] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:53 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:53.181755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1cab-8771-4c08-ba88-f314dbecd41a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:53.194982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d1cab-8771-4c08-ba88-f314dbecd41a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:53.199723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:53.200854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.201349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.201833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.202737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:53.204557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:53.216975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 23 11:46:53.222875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 444/889] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:53 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:53.226117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:53.236162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f547-ab53-4a6c-8da7-cec2c96d1df8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:53.241525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:53.242537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.243141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.243610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.244571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:53.245070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:53.246967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2f5f-485f-43d6-8ba2-d16c147fb255 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:53.252437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 446/890] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:46:53 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:53.258881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:53.269410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18088-f746-4a47-9a87-d8b4bb14dde8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:53.274351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:53.275377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.275934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.276486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.277478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:53.278151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:53.280056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dfc82-cdae-486b-944b-3d8f515acc82 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:53.285663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 445/891] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:46:53 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:53.910103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75165b-32dd-4864-a86c-eb62351dc735 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.910659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75165b-32dd-4864-a86c-eb62351dc735 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.910659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75165b-32dd-4864-a86c-eb62351dc735 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.912698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 447/892] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:53.918773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005ec5-a0b9-449f-82fd-f7759586a106 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.919062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005ec5-a0b9-449f-82fd-f7759586a106 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.919337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005ec5-a0b9-449f-82fd-f7759586a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.937569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0b005ec5-a0b9-449f-82fd-f7759586a106 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:53.938811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0b005ec5-a0b9-449f-82fd-f7759586a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:53.946898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 446/893] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:53 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:53.971209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75165b-32dd-4864-a86c-eb62351dc735 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:53.974156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed4f6f-8abc-4bf9-af0c-1597dcf17736 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.974449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed4f6f-8abc-4bf9-af0c-1597dcf17736 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.974754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed4f6f-8abc-4bf9-af0c-1597dcf17736 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.976811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 447/894] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:53.983757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.984031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.984296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.985286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75165b-32dd-4864-a86c-eb62351dc735 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:53.989852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:53.990964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:53.991351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:53.992316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:53.992560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:53.994249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.004031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:54.005204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:54.010085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 448/895] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:46:53 2021] POST /identity/v3/services => generated 251 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:54.030727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 448/896] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:53 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:54.052154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:54.063189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770489-a4a2-45c4-b197-c5c8f5afbc88 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:54.068069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:54.068908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:54.069181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:54.069451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:54.070129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:54.071914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.085021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 23 11:46:54.090190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 449/897] 10.222.0.65 () {56 vars in 1153 bytes} [Thu Dec 23 11:46:54 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:54.093809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:54.103539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728329a2-b8ca-4105-9991-bd6ac5054554 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:54.108972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:54.109655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:54.109928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:54.110193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:54.111014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:54.111375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:54.113016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.124336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 449/898] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:54 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:54.125753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:54.136286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845d71-340c-44fb-90d1-0d96836c9d23 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:54.141248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:54.142029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:54.142306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:54.142623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:54.143412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:54.143717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:54.145649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.157146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 450/899] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:54 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:54.158653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:54.169580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d409ef2-d65e-4b2a-96fb-3ddfcb7fbeb4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:54.174557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:54.175267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:54.175544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:54.175812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:54.176695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] RBAC: Adding query filter params (interface=public, service_id=9ee5f54c0930488dbe67b103f3d2e2bf, region_id=RegionOne) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:54.176999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:54.178709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd246e5-10a8-456a-a0af-a14cea91b978 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.190705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 450/900] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:46:54 2021] GET /identity/v3/endpoints?service_id=9ee5f54c0930488dbe67b103f3d2e2bf&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:54.193020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:54.204018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30745945-a249-4dca-acd6-3ba480115238 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:54.208888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:54.209564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:54.209890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:54.210160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:54.210946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:54.212664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9a9bf-1519-48a6-83b4-b05f2ef89883 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:54.226736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 451/901] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:46:54 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:46:55.172974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508c2-7be8-4060-aa9e-a703aab6fc13 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.173703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508c2-7be8-4060-aa9e-a703aab6fc13 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.173703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246508c2-7be8-4060-aa9e-a703aab6fc13 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.175548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 451/902] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:55.181444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.181949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.182111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.200017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:55.201227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:55.209564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 452/903] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:55 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:55.233266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246508c2-7be8-4060-aa9e-a703aab6fc13 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.245902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246508c2-7be8-4060-aa9e-a703aab6fc13 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.250306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.251167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.251444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.251716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.266883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:55.274093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:46:55.275729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 452/904] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:55.282875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.292184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c69e4-0600-4cfb-916a-eb4798d31368 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.296862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.297538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.297817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.298086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.298903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:55.299205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.300830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.310022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 453/905] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:55.316120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.326686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ec752-29fc-4bf2-87cb-984cabde121d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.331210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.331996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.332267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.332532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.343822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.345769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.365541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:55.367241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 453/906] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:55.373811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.387289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787776-c7b5-41e7-8099-5d1b152a755c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.393573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.395045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.395542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.396014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.396999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:55.397809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.399719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.413888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 454/907] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:55.424507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.435181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08a52-3061-4eb5-8cd7-54a7c1c3f49b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.440969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.442128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.442804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.443324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.452482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.454924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.470284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:55.472191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 454/908] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:55.478830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.489553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94cf5-28ed-48b4-bb02-99d721d60457 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.494779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.495747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.496268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.496790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.497838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:55.498388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.500433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.518789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 455/909] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:55.525098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.535481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a1cfe-7599-4719-ae35-874767752956 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.540520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.541637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.542113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.542618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.554051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.556221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.573633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:55.575450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 455/910] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:55.581712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.592046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cba3a-d957-41cf-9e01-2b2516445b59 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.596973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.597924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.598397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.598930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.599876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:55.600449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.602288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.614968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 456/911] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:55.621723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.634428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7447a2-d750-4e20-a7e6-53c858d916bb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.639747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.640907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.641381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.641909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.649657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.651913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.665964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:55.667751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 456/912] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:55.675980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.687146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b83c2-432a-427e-9814-8b31aecbf164 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.693838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.694911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.695412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.695975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.697175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:55.697540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.699571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3cedf-220e-43c1-befe-24b07f85d927 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.715755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 457/913] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:55.723256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.736338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ad2a-04ff-4330-a8d3-33322072656f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.741153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.742030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.742305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.742605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/95d72db4299b40cba45b3db1bc835939/roles/bf26998ac0a849a88ff55d1e94d31e2b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.744845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=95d72db4299b40cba45b3db1bc835939, role_id=bf26998ac0a849a88ff55d1e94d31e2b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.747802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227b9c7-be67-4546-993b-8a798c1c300c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.769849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 457/914] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:46:55 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/95d72db4299b40cba45b3db1bc835939/roles/bf26998ac0a849a88ff55d1e94d31e2b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:46:55.789175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c904d-2e93-4479-aaec-c06b4d5ea7c8 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.789501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c904d-2e93-4479-aaec-c06b4d5ea7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.789735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c904d-2e93-4479-aaec-c06b4d5ea7c8 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.791961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 458/915] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:55.798407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce9d31-0c4e-4b6d-af72-c538d6d3703a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.798750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce9d31-0c4e-4b6d-af72-c538d6d3703a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.798986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce9d31-0c4e-4b6d-af72-c538d6d3703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.817900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c5ce9d31-0c4e-4b6d-af72-c538d6d3703a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:55.819123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c5ce9d31-0c4e-4b6d-af72-c538d6d3703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:55.891387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 458/916] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:55 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:55.915622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c904d-2e93-4479-aaec-c06b4d5ea7c8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:55.928733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c904d-2e93-4479-aaec-c06b4d5ea7c8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:55.933380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:55.934096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:55.934376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:55.934694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:55.935507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:55.937131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7244d-fd1b-4eeb-9bd6-53e53c4a7225 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:55.953230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 459/917] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:46:55 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:56.494006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c1f3-03bd-4046-bad1-04d9d340f14c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.494692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c1f3-03bd-4046-bad1-04d9d340f14c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.494692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c1f3-03bd-4046-bad1-04d9d340f14c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.496839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 459/918] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:56.502815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.503348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.503512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.521587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:56.522783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:56.542741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 460/919] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:56 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:56.563450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85c1f3-03bd-4046-bad1-04d9d340f14c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.576040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85c1f3-03bd-4046-bad1-04d9d340f14c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.580436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.581319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.581593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.581858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.582542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.584139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.595658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 23 11:46:56.602130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 460/920] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:56.603535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.612943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996478f-d111-4128-9540-a9af4166f0c4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.617916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.618605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.618930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.619201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.619916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:56.620215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.622058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970af6-41fb-4fb1-8b3a-e5732ce28029 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.632184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 461/921] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:56.633565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.643679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d60d1-9aee-41a9-b990-6b0a8df23aeb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.648343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.649589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.650037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.650498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.651304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:56.651608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.654215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.654713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6610a-23a8-4957-bea3-02dceb3b015d None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.655000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6610a-23a8-4957-bea3-02dceb3b015d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.655320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6610a-23a8-4957-bea3-02dceb3b015d None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.658531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 462/922] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:56.659965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 461/923] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:56.666543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.666843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.667116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.669670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.680267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b717862-1de1-4c20-b133-61d4ed728061 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.685180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.685942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.686227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.686504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.687424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] RBAC: Adding query filter params (interface=public, service_id=198fd4cda05b4cbc8fb256422c3308ae, region_id=RegionOne) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:56.687727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.689362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.695665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 462/924] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/endpoints?service_id=198fd4cda05b4cbc8fb256422c3308ae&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:56.698143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:56.699711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:56.701509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.709798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 463/925] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:56 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:56.712910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f5c52-7dcc-432f-a5bf-aebafabccd80 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.718052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.719007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.719561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.720031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.720996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.722870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.730114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 463/926] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:46:56.735198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.745700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144a827-f78e-4520-8500-d5d9376961b5 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.751119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.752402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.752899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.753388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.754279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.756240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.769167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 23 11:46:56.776526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 464/927] 10.222.0.65 () {56 vars in 1153 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:56.778349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.789161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db60a-18ca-43be-b0ff-17a3b1d6668c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.794677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.795825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.796298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.796789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.797777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:56.798294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.800284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.810667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 464/928] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:56.813789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.825055 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6d078-5c5a-4d1a-9634-c381291b5330 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.830643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.831763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.832264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.832816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.833892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:56.834398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.836420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed415-bcd6-4060-858e-428b6e44fb11 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.846656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 465/929] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:56 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:56.849814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:56.861347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49999ac-785e-428e-8613-6d2e2bd09640 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:56.866961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:56.867961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:56.868400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:56.868812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:56.869771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:56.871114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:46:56.871114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:46:56.871114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:46:56.872419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ac9fa-8208-4e77-9d1c-09b4f59c0971 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:56.902763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 465/930] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:46:56 2021] POST /identity/v3/endpoints => generated 347 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:46:58.199181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3d00-ff0e-484d-a626-66f641455681 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.199835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3d00-ff0e-484d-a626-66f641455681 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.199835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3d00-ff0e-484d-a626-66f641455681 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.201812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 466/931] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:58.208852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.208852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.208852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.226109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:58.227327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:58.245242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 466/932] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:58 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:58.269427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3d00-ff0e-484d-a626-66f641455681 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.282443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3d00-ff0e-484d-a626-66f641455681 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.286910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.287731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.288009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.288273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.299823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:46:58.307152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:46:58.308627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 467/933] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:58.315103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.324220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb727562-7938-4a74-ac0a-d17c28328a35 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.328871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.329550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.329827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.330099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.330910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.331215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.332811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.344068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 467/934] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.349975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.360235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5f769-0e80-48ae-89c5-442762a5a391 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.364816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.365928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.366209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.366481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.377134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.378997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.396237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-244cc7c3-584a-4df7-aa5a-ddce1a0b69d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:58.397772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 468/935] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:58.404095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.416597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ab105-5c1f-4357-97f3-984b3c959908 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.421633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.422574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.422996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.423410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.424293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.424737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.426616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.428938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190263b0-1415-48f7-b5e8-90b8324add4b None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.429416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190263b0-1415-48f7-b5e8-90b8324add4b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.429838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190263b0-1415-48f7-b5e8-90b8324add4b None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.432123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 469/936] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:58.438780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.439352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.439771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.440892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 468/937] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.447309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.459137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95d91c-eeb3-447c-baed-986cec3747ae admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.459927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:58.461562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:58.463714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.464533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.464816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.465431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.477160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 470/938] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:58 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:46:58.477334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.477334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.492536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 23 11:46:58.494091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 469/939] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:46:58.496992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.500199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.506875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad04a-5f83-463a-b9ec-5ed13dddcc49 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.511194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c9c4b-d806-41c6-95b2-8de317a23ffe admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.511670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.512832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.513348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.513852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.514928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.516283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.517006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.517133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.517416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.517782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.518697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.519074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.521666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.529556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 23 11:46:58.536596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 471/940] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:58.537755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.542079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 470/941] 10.222.0.65 () {56 vars in 1170 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.548308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.552024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039142b0-b688-4bcd-af44-d8c5dcf437f5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.556777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.557656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.557870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420de4a2-2383-4f8c-9c44-412abb2768b2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.558289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.558958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.560062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.560636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.562724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.563034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.563361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.563640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.563913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.569507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 472/942] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.574649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.574649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.576181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.585909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646caba-d935-4c62-ba39-e0520ca3b95e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.587057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 471/943] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:46:58.591454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.592681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.593169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.593661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.594744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.595248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.595597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.597256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.605637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777cb9-2522-4382-ae4d-0ded734a98bb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.610392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.611210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.611489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.611759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.620755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 473/944] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:46:58.622034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.623503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.625358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.639664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab853f-1f7f-4f76-9e20-b58a74d2c0de admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.647170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.648126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.652252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:46:58.652864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.653347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.654375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] RBAC: Adding query filter params (interface=public, service_id=0b1a6727b05f4bdfa99c02bd8a1a83ad, region_id=RegionOne) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.654947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.656746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.667021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 474/945] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/endpoints?service_id=0b1a6727b05f4bdfa99c02bd8a1a83ad&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.672322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 472/946] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:58.673220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.673723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.691492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6886-1431-4722-b9a7-22a1b1e80dff admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.693443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3303-bb6d-4220-a379-e71767c8e21e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.698711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.699494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.699957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.700398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.700689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.700790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.700957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.701411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.701699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.702005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.702725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.703639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.704687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.718756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 475/948] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/services => generated 1497 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:46:58.722191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 473/948] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.727830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.748431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c41d3b-fed4-4d36-b00d-663d98534ff3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.772236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.773078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.773361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.773642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.791025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.792992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.828277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:46:58.834541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 476/949] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:58.842445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.854112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e9088-e90f-4dd1-8885-4ddccf4376dd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.867125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.869137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.870282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.871146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.872873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.874169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.876654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865d2ff-473a-4122-9e9e-f1eef5f281bc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.906230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 474/950] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:58.915647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:58.932019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9c17-f0dd-4dd5-b7ff-b46b88e52941 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:58.954542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:58.954542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:58.954542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:58.954542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:58.954967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] RBAC: Adding query filter params (role.id=bf26998ac0a849a88ff55d1e94d31e2b, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=95d72db4299b40cba45b3db1bc835939) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:58.954967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:58.954967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bfc65-1df4-490b-9e19-0c0fdb820f22 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:58.961341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 477/951] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:46:58 2021] GET /identity/v3/role_assignments?user.id=95d72db4299b40cba45b3db1bc835939&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=bf26998ac0a849a88ff55d1e94d31e2b => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:59.184286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c23e-b793-4bae-ac64-de9da99d4fb0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.184629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c23e-b793-4bae-ac64-de9da99d4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.184925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934c23e-b793-4bae-ac64-de9da99d4fb0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.186781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 475/952] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:46:59.194742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.195037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.195292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.215089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:59.216723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:59.225064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 478/953] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:59 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:59.250041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934c23e-b793-4bae-ac64-de9da99d4fb0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.264451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934c23e-b793-4bae-ac64-de9da99d4fb0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.269261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.270182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.270585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.270921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.271673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.273347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.285438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 23 11:46:59.287063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 476/954] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:59.294148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.303751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7a369-6720-4ee8-a182-5338ba5f23aa None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.308311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.309237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.309942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.310339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.311222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:59.311532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.313135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.319014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 479/955] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:59.325355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.335612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafa8f7-f266-45b7-aa45-0b2c05c6b97c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.341579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.342329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.342713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.343050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.343846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:59.344222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.345895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74df30c-d296-4247-a4d2-a1ebaf7985de admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.362108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 477/956] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:59.368715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.379420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c743-ef7d-4bb7-8ba9-d4faa76c6822 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.384412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309233ff-c5cd-4426-a030-c1eb6962f4c9 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.384692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309233ff-c5cd-4426-a030-c1eb6962f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.384946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.385073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309233ff-c5cd-4426-a030-c1eb6962f4c9 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.386024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.386553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.387116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.388119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.388223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 478/957] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:46:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:46:59.390081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.392881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.393189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.393510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.413919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 480/958] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:46:59 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:46:59.419330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:46:59.420986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:46:59.441556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 479/959] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:46:59 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:46:59.465376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.476319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1111b8-12a1-4b2c-9622-38343002e383 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.481150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.482129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.482413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.482729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.483417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.485125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.498320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 23 11:46:59.499955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 481/960] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:46:59.507980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.517976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2879-0477-49bd-b24a-8ac6f3c38c53 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.523470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.524520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.525020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.525511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.526439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:59.526984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.529106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4325d92-b058-42a5-b71e-cfd37ad4fd8f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.539147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 480/961] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:46:59.541933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:46:59.556248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333e9db-a2ba-434f-a70f-8c066f5477e3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:46:59.562062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:46:59.563248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:46:59.563739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:46:59.564279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:46:59.565267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:46:59.565785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:46:59.567794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871381b8-e027-47bb-a0ae-d0a859ea9977 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:46:59.578578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 482/962] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:46:59 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:01.557639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4d91-b3e3-4f38-9767-a8e45fb65f68 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.558172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4d91-b3e3-4f38-9767-a8e45fb65f68 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.558172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d4d91-b3e3-4f38-9767-a8e45fb65f68 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.560422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 481/963] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:01.567059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.567535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.567607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.586316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:01.587553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:01.596443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 483/964] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:01 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:01.620565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d4d91-b3e3-4f38-9767-a8e45fb65f68 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.633374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d4d91-b3e3-4f38-9767-a8e45fb65f68 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.638253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.639125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.639401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.639669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.640357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.641970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.653435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-bd383d25-eaea-44f4-93d8-deab46a0e318 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 23 11:47:01.655084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 482/965] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:01.661520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.671582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e407b5-1d7c-4bd9-834a-eb81a6f336db None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.677876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671a53-d1ad-41b1-9006-19f6c915b579 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.678157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671a53-d1ad-41b1-9006-19f6c915b579 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.678967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671a53-d1ad-41b1-9006-19f6c915b579 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.682533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.682686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 483/966] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:01.682792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.682792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.682792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.683184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] RBAC: Adding query filter params (name=image) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:01.684456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.686308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.689232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.689514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.689783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.694284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 484/967] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services?name=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:01.703578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.716870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fb9a-484b-42e9-b4f7-3601715e08bc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.717451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:01.718874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:01.721724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.722545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.722941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.723324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.724233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:01.724609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.726281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.727436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 484/968] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:01 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:47:01.737949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 485/969] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services?type=image => generated 122 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:01.752467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.762428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307facc7-6ca9-4dcc-bd62-8fe43a9a5113 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.767603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.768453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.768735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.769010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.769727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.771467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.784624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 23 11:47:01.786266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 485/970] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:01.793204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.804615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320c6c3-4554-4790-b830-6dcc13529b27 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.810355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.811467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.812024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.812507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.813587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:01.814093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.815975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.822041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 486/971] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:01.829318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.841040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843ae99-e9ae-49c8-bcb2-c395d3ded3ed admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.845799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.846476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.846853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.847133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.847899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:01.848203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.849845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616e111-928e-4e91-bb97-8a95404a1b36 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.856289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 486/972] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:01.862397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:01.873496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737589-5763-4b55-b97c-dc65dc5f5384 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:01.878673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:01.879667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.880154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.880647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.881692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:01.883552 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab765c9-4c3d-426f-a7bf-417e699a0f94 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:01.906212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 487/973] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:47:01 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:01.968622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5defa92-79cc-4bd4-94c8-8e967cca5e71 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.968983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5defa92-79cc-4bd4-94c8-8e967cca5e71 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.969181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5defa92-79cc-4bd4-94c8-8e967cca5e71 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.971462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 487/974] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:01.977877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:01.978398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:01.978843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:01.999519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:02.001122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:02.020839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 488/975] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:01 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:02.045683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5defa92-79cc-4bd4-94c8-8e967cca5e71 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:02.059251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5defa92-79cc-4bd4-94c8-8e967cca5e71 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:02.064247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:02.065408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.065887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.066231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.067255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:02.069462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:02.070986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.common [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 23 11:47:02.098348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.sql.core [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 23 11:47:02.098348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 23 11:47:02.098348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [parameters: {'id': '87ec72b57234446c8023210b8d589a79', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 23 11:47:02.098348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 23 11:47:02.105951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87ec72b57234446c8023210b8d589a79.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 87ec72b57234446c8023210b8d589a79. Dec 23 11:47:02.107773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 488/976] 10.222.0.65 () {60 vars in 1161 bytes} [Thu Dec 23 11:47:02 2021] POST /identity/v3/projects => generated 262 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:02.115675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:02.128731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2179e-a2e2-4936-8047-592ea3809097 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:02.133566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:02.134451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.134788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.135129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.143650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:02.145627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:02.161742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-36ce3cc4-09d1-4b97-b2b1-6207e137d958 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:47:02.163465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 489/977] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:02.170452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:02.182408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0b22c-e12e-4ae2-9ff6-cffc89966595 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:02.187894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:02.188639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.188988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.189370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.190182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:02.190645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:02.193008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:02.207429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9560d-7d36-4d12-a98a-aa1872f24feb None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.208096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9560d-7d36-4d12-a98a-aa1872f24feb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.208573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9560d-7d36-4d12-a98a-aa1872f24feb None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.210611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 490/978] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:47:02.215315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 489/979] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:47:02 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:02.217635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189584ce-061d-4c23-8f2a-cb86b23701af None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.218024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189584ce-061d-4c23-8f2a-cb86b23701af None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.218394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189584ce-061d-4c23-8f2a-cb86b23701af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.239470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-189584ce-061d-4c23-8f2a-cb86b23701af None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:02.242094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-189584ce-061d-4c23-8f2a-cb86b23701af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:02.251088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 491/980] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:02 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:47:02.274933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:02.285881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc984-86e5-4413-80cd-64b83ca216c2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:02.290791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:02.291525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:02.291803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:02.292075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:02.292870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:02.294638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f0f06-a359-416c-b6b2-e438b2c49b8a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:02.318711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 490/981] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:47:02 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:04.270962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149dba6-329c-4411-9679-374f16c1708e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.271502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149dba6-329c-4411-9679-374f16c1708e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.271805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149dba6-329c-4411-9679-374f16c1708e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.275553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 492/982] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:04.285507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56147-4825-43e4-bc24-ca2a1e934fc7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.286035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56147-4825-43e4-bc24-ca2a1e934fc7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.286144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56147-4825-43e4-bc24-ca2a1e934fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.307792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7ee56147-4825-43e4-bc24-ca2a1e934fc7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:04.310162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7ee56147-4825-43e4-bc24-ca2a1e934fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:04.330206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 491/983] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:04.366533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149dba6-329c-4411-9679-374f16c1708e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.380054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149dba6-329c-4411-9679-374f16c1708e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.384580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.385252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.385538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.385812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.386647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.388937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c670-7f86-4812-a0e4-b85d3eb547a6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.406704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 493/984] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:04.450112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff986-d369-4511-8bf0-aaed82181e83 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.450548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff986-d369-4511-8bf0-aaed82181e83 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.450717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff986-d369-4511-8bf0-aaed82181e83 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.452935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 492/985] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:04.459874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.460153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.460433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.483610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:04.485215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:04.506190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 494/986] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:04.531431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ff986-d369-4511-8bf0-aaed82181e83 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.544560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ff986-d369-4511-8bf0-aaed82181e83 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.549231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.550121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.550406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.550716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.551395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.553063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.565452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 23 11:47:04.567088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 493/987] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:04.573805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.583191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa399d6-b192-4b82-9790-40ea4edf3663 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.587959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.588647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.588932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.589206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.590016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.590322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.592183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.598187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 495/988] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:04.604835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.615772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d286e8-3f7c-401e-8d6b-0dfc02e71774 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.620793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.621608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.621890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.622161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.622937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.623241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.624876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.631245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 494/989] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:04.637885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.648117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980507da-f22f-4feb-8cb2-5b408255b157 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.653328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.654008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.654290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.654589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.655409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] RBAC: Adding query filter params (interface=admin, service_id=0b1a6727b05f4bdfa99c02bd8a1a83ad, region_id=RegionOne) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.655719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.657311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94b9e-b970-419e-8f54-c2e673dcb2c0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.664254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 496/990] 10.222.0.65 () {56 vars in 1270 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/endpoints?service_id=0b1a6727b05f4bdfa99c02bd8a1a83ad&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:04.670794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.682409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec981b-7294-4e3e-b248-1edb000593d8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.687582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.688252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.688529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.688854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.689551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.691187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab4e14-4c6e-424d-94eb-3f9345f913f6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.700643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 495/991] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:47:04.725760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebedf-2233-49d1-bc53-8f28020777cd None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.726037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebedf-2233-49d1-bc53-8f28020777cd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.726456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cebedf-2233-49d1-bc53-8f28020777cd None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.728739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 497/992] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:04.735000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c730d0-8c8b-49b5-be20-5aa371b65061 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.735521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c730d0-8c8b-49b5-be20-5aa371b65061 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.735940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c730d0-8c8b-49b5-be20-5aa371b65061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.755639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-43c730d0-8c8b-49b5-be20-5aa371b65061 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:04.757104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-43c730d0-8c8b-49b5-be20-5aa371b65061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:04.766378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 496/993] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:04.775832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee432-aad5-4ff4-8d68-6aef37f0df91 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.776133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee432-aad5-4ff4-8d68-6aef37f0df91 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.776394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ee432-aad5-4ff4-8d68-6aef37f0df91 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.778753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 498/994] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:04.785447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.786049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.786493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.797512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ee432-aad5-4ff4-8d68-6aef37f0df91 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.807327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:04.809130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:04.810947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ee432-aad5-4ff4-8d68-6aef37f0df91 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.815710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.816381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.816659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.816930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.817665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.826534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.826534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.common [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 23 11:47:04.826820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 497/995] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:04.839592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.sql.core [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 23 11:47:04.839592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 23 11:47:04.839592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [parameters: {'user_id': '29877a9b98304d6e87da50f7a03f16ed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 23 11:47:04.839592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 23 11:47:04.844586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.854989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdbb92-4e7b-42c0-a5b4-3a7de7c60550 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.860019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 23 11:47:04.860418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.861362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.861652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.861930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.862682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.863581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 499/996] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:47:04 2021] POST /identity/v3/users => generated 160 bytes in 66 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:47:04.864453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.872093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.877952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 23 11:47:04.884510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7eff7-4f31-4ba7-9d5b-5d3ef83e5335 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.884955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 498/997] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:04.887624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.890089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.890974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.891346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.891573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.899845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320ff11-17dd-4e98-a60f-d29bc175d30e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.900098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.902860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.905810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.906888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.907411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.907945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.908972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.909480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.911384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.922844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 23 11:47:04.922844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 500/999] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:47:04.923423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 499/999] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:04.925947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.927123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.937226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c412a-8985-4ba0-bd6f-a26dda708063 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.943279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56cc6b-0de9-4a46-9ff3-5bb1b7a6107c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.943423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.943997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.944283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.944557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.945304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.945724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.947679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.950407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.951228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.951551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.951890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.952764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.953129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.954629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 500/1000] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:04.955456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabe8b1-b978-43ef-a995-a2e835bf98e4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.960564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:04.972003 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3144dbd-d062-4aec-bca3-0df02f3fbbb3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:04.984427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:04.985273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:04.985674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:04.986036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:04.987044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] RBAC: Adding query filter params (interface=public, service_id=016cdb9e3d1e42a2b46cf76125bacc2b, region_id=RegionOne) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:04.987440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:04.989158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:04.995570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 501/1001] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/endpoints?service_id=016cdb9e3d1e42a2b46cf76125bacc2b&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:05.003594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 501/1002] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Dec 23 11:47:04 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:05.005405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:05.015861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545046b-5ae5-497d-8719-67c66f29208b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:05.021089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:05.021932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:05.022337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:05.022735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:05.023611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:05.025477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058d1b1-51ec-465e-bed1-f29feb5b59e4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:05.034405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 502/1003] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:47:05 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:47:06.865797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2310-5d56-4acc-b0b2-63fb9a32ba61 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:06.866375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2310-5d56-4acc-b0b2-63fb9a32ba61 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:06.866375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe2310-5d56-4acc-b0b2-63fb9a32ba61 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:06.868163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 502/1004] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:06.876032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770001-d627-49a5-97f6-f9259abec5af None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:06.876561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770001-d627-49a5-97f6-f9259abec5af None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:06.876561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07770001-d627-49a5-97f6-f9259abec5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:06.896812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-07770001-d627-49a5-97f6-f9259abec5af None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:06.898000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-07770001-d627-49a5-97f6-f9259abec5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:06.906280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 503/1005] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:06 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:06.930299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2310-5d56-4acc-b0b2-63fb9a32ba61 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:06.943436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe2310-5d56-4acc-b0b2-63fb9a32ba61 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:06.948249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:06.949026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:06.949515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:06.950148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] PATH_INFO: `/v3/services/image` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:06.950310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:06.951948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:06.963032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 23 11:47:06.964161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 503/1006] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Dec 23 11:47:06 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:06.971148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770001-d627-49a5-97f6-f9259abec5af None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:06.980666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07770001-d627-49a5-97f6-f9259abec5af None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:06.985795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:06.986681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:06.987044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:06.987387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:06.988123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:06.988432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:06.990382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:06.997590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 504/1007] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:06 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.003517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.015167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811d68-d6fe-4339-839e-e1b052f920fa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.021441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.022139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.022416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.022725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.023502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] RBAC: Adding query filter params (type=image) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.023812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.025503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.032068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 504/1008] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.038614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.049388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d8b0-03fb-4486-b19d-73f9dd400e8d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.054206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.054954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.055305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.055587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.056399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] RBAC: Adding query filter params (interface=public, service_id=bf5d06eaa3e744a1883824e412605c07, region_id=RegionOne) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.056709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.058326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2eb5-0ebb-43f8-9771-be9df0c406d7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.065536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 505/1009] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/endpoints?service_id=bf5d06eaa3e744a1883824e412605c07&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.071022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.082463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169fbc9-74e8-453c-b20a-9a01340dcd8e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.087483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.088146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.088426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.088698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.089395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.091375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70eec7-54bf-43c1-8bc9-452fce3b97ff admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.098852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 505/1010] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:47:07.161989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d4da-d41d-4513-bfce-763ae0b3b3ad None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.162298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d4da-d41d-4513-bfce-763ae0b3b3ad None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.162790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112d4da-d41d-4513-bfce-763ae0b3b3ad None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.164988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 506/1011] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:07.171793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.172301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.172436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.192427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:07.194054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:07.203185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 506/1012] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:07 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:07.226788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112d4da-d41d-4513-bfce-763ae0b3b3ad None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.241208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112d4da-d41d-4513-bfce-763ae0b3b3ad None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.246697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.247582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.247856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.248147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.248810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.250424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.263014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 23 11:47:07.264468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 507/1013] 10.222.0.65 () {56 vars in 1147 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:07.271570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.281792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f28a-bfb0-4e1b-b206-8609925a0647 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.287538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.288228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.288674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.288791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.289510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.289807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.291459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.297603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 507/1014] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.304005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.314306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e0928-d3e9-43c0-9213-aeb2dcabb9e9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.319285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.319945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.320257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.320536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.321268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.321568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.323207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274bab3-685d-4bc1-8d44-1c0f3d456a05 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.328691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 508/1015] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.335717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.352279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71513c-0fec-48ec-a623-907dcf00a117 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.362256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.362961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.363987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.363987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.364303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.366179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389f0c2-c21f-4d12-9a86-1191e642420c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.384379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 508/1016] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:47:07 2021] POST /identity/v3/endpoints => generated 325 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:47:07.415915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fe9c-190c-41fe-af64-008d04e3e538 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.416116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fe9c-190c-41fe-af64-008d04e3e538 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.416407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186fe9c-190c-41fe-af64-008d04e3e538 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.420745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 509/1017] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:07.426912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.427247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.427475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.446963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:07.448169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:07.467971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 509/1018] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:07 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:07.491477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186fe9c-190c-41fe-af64-008d04e3e538 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.506163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186fe9c-190c-41fe-af64-008d04e3e538 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.512840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.514586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.515210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.515809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.516934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.519134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.532347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 23 11:47:07.534329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 510/1019] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services/compute => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:47:07.540812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.551238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc902d-45c2-4e8d-a955-94903200a6b3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.557026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.557867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.558252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.559140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.559994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.560402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.562135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.573390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 510/1020] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.575323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.589063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf08e-17a8-4121-b446-aaae945e2ec5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.595033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.595855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.596420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.596625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.597511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:07.597855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.599601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d42cf4-0d40-479c-93a2-0ff9941b0236 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.606167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 511/1021] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Dec 23 11:47:07 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:07.612265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:07.623250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4bcad-56d2-4343-bf73-575e4229dbbe admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:07.629549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:07.630239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:07.630591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:07.630856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:07.631611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:07.633224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef1f6e-0d26-4cd3-8ed3-afe1bc6792d1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:07.655494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 511/1022] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:47:07 2021] POST /identity/v3/endpoints => generated 334 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:09.515356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c7b73-eb06-490f-b824-83da9abe667d None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.515982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c7b73-eb06-490f-b824-83da9abe667d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.515982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c7b73-eb06-490f-b824-83da9abe667d None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.517828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 512/1023] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:09.523475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.523889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.524055 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.542259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:09.543882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:09.562224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 512/1024] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:09 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:09.587760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c7b73-eb06-490f-b824-83da9abe667d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.604316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c7b73-eb06-490f-b824-83da9abe667d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.609849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.610620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.610920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.611176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] PATH_INFO: `/v3/services/image` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.611844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.613446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.626127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 23 11:47:09.627594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 513/1025] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Dec 23 11:47:09 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:09.634359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.644545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295d697-6d11-47b9-ba78-332b3dffdc2b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.649852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.650566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.650854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.651133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.651910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:09.652224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.653985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.659535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 513/1026] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:09 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:09.665736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.676473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cfb14-b2ba-46b5-aea7-ce781f2dd57c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.681447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.682121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.682412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.682720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.683534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:09.684185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.685461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa38c7-b877-4a31-9896-3b6b75293918 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.690973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 514/1027] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:09 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:09.697164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.708034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78f29-8be4-4547-9b14-237a5b17a154 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.712799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.713528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.713874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.714213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.715774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.717642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9833d-a569-4689-8c75-9997e64d28ed admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.741005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 514/1028] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:47:09 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:09.785796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70311-7b9e-4870-b5ec-cd15037dd9f0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.786049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70311-7b9e-4870-b5ec-cd15037dd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.786289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e70311-7b9e-4870-b5ec-cd15037dd9f0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.788388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 515/1029] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:09.795451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.795800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.796193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.817027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:09.818216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:09.840369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 515/1030] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:09.865500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e70311-7b9e-4870-b5ec-cd15037dd9f0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.879653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e70311-7b9e-4870-b5ec-cd15037dd9f0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.884560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.885382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.885644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.885970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.888005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.889775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066929be-7b2b-49bb-b727-efad3084998e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.891809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 516/1031] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:09.898259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:09.908558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b865a99-1011-4347-989b-900cbd4557c8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:09.913764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e833d-b387-456d-8334-76598355f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:09.914887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e833d-b387-456d-8334-76598355f693 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:09.915425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e833d-b387-456d-8334-76598355f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:09.915971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e833d-b387-456d-8334-76598355f693 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:09.916957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e833d-b387-456d-8334-76598355f693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:09.919371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e833d-b387-456d-8334-76598355f693 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:09.948763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 516/1032] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:47:09 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:47:10.148070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6964a-523a-4ba0-96d6-01a6adfbc4bd None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.148454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6964a-523a-4ba0-96d6-01a6adfbc4bd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.148835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6964a-523a-4ba0-96d6-01a6adfbc4bd None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.150870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 517/1033] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:10.157453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.157698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.157988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.177680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:10.179098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:10.242436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 517/1034] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:10.268326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6964a-523a-4ba0-96d6-01a6adfbc4bd None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.281116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6964a-523a-4ba0-96d6-01a6adfbc4bd None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.285420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.286225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.286502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.286794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.299226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:10.307721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:47:10.309361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 518/1035] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:47:10.315806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.325411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c115c26-82a4-49ae-a6a9-f3d520a2e6db None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.331119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.331903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.332286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.332658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.333530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.333936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.335656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.345030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 518/1036] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:10.351613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.361780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b874-2904-4241-a20c-0d792fa8efa8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.366520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.367393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.367669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.367936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.378197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.380048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.397783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:10.402787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 519/1037] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:10.405565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.415283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc21706-5fb1-4611-be85-497cae6a08d8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.420184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.420831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.421104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.421371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.422096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.422394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.424002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.436263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 519/1038] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:10.442372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.452842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791bd9a-2ba5-4b0c-9094-0dcba1e195df admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.457657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.458588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.458985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.459399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.467578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.469725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.484186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:47:10.485699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 520/1039] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:10.492155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.503481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a568d-5c0d-4e18-b1de-20434ed9391e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.508385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.509141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.509477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.509797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.510723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.511101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.513074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.537478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 520/1040] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:10.538774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.548460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686aeaa-645b-4d06-88e9-0943a330e4aa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.553053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.553682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.553953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.554217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.562454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.564211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.578376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 521/1041] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:10.579712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.589903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac5810-f4a1-49d2-9ff1-57934665ff9a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.595326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.596239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.596618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.596988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.608704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.611619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.630550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:10.632201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 521/1042] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:10.638917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.649609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262d2d3-abbe-4f61-8ae8-b3b756f4cd1b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.656282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.656902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.657177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.657437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.658197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.658496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.660163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.678424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 522/1043] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:10.680261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.696941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905811a-73c0-4534-a9c3-acff9cc7d36c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.703154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.704124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.704457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.704815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.712494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.714554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.728720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:47:10.730316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 522/1044] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:10.737535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.748666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8251ccf-36f6-4078-967c-97e4ed3a40ba admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.753417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.754078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.754352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.754669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.755451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.755748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.757602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68e5a6-40ca-487c-999c-f33fe1b75c66 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.771926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 523/1045] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:10.778843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:10.789954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af828c9b-26bf-434a-9078-31a5987c69ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:10.794943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:10.795609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:10.795881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:10.796157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:10.797002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] RBAC: Adding query filter params (role.id=bf26998ac0a849a88ff55d1e94d31e2b, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:10.797305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:10.799253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01061bba-410c-439a-a26a-7ab819f39a33 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:10.806200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 523/1046] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:10 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=bf26998ac0a849a88ff55d1e94d31e2b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:12.189362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd0c8-28c6-4715-82c2-914a14f22001 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.189921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd0c8-28c6-4715-82c2-914a14f22001 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.189921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdd0c8-28c6-4715-82c2-914a14f22001 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.192014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 524/1047] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:12.198618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.199221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.199221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.217349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:12.218573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:12.227367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 524/1048] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:12.251415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdd0c8-28c6-4715-82c2-914a14f22001 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:12.264958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdd0c8-28c6-4715-82c2-914a14f22001 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:12.270443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:12.271117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.271389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.271718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.280507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:12.282253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc68aed-301f-4740-83c2-2425c9eeafe5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:12.291513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 525/1049] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:12.297986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:12.307573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca60802-ba84-48fc-bd08-ccae0d8a6528 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:12.312439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:12.313256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.313531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.313797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.315022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:12.316687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a84bd4-047c-411e-ab5f-c189b09a9e51 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:12.318439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 525/1050] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:12.368987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb023-903d-405d-815c-4cf3b9e405fd None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.369271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb023-903d-405d-815c-4cf3b9e405fd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.369537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bb023-903d-405d-815c-4cf3b9e405fd None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.371512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 526/1051] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:47:12.377946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.378317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.378703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.398477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:12.399727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:12.408869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 526/1052] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:12.434289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb023-903d-405d-815c-4cf3b9e405fd None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:12.447588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bb023-903d-405d-815c-4cf3b9e405fd None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:12.452388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:12.453199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.453522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.453834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.455148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:12.456857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031e485-b0ab-48d6-a19d-7ebcd381ccc1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:12.458758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 527/1053] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:12.465592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:12.475293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29182291-82c8-4eaa-8752-dc3e08ad3472 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:12.480573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:12.481415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:12.481793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:12.482261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:12.483074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:12.485126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386f6ec-26cc-40b8-b394-4a3ab4e22faf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:12.509171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 527/1054] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:47:12 2021] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:13.218554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7746-8208-4c10-8bf6-ce3ee09c2318 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.219111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7746-8208-4c10-8bf6-ce3ee09c2318 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.219111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7746-8208-4c10-8bf6-ce3ee09c2318 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.220891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 528/1055] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:13.226802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.227256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.227351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.246152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:13.247688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:13.255861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 528/1056] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:13.280541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b7746-8208-4c10-8bf6-ce3ee09c2318 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.294820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b7746-8208-4c10-8bf6-ce3ee09c2318 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.299478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.300287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.300560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.300830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.312360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:13.319733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:47:13.320966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 529/1057] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:13.327642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.337045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a8675-81d5-487e-8922-224bbd6c2f12 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.342720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.343438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.343712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.343981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.344749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:13.345050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.346646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.356393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 529/1058] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:13.363290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.374856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ef218-9cab-4abb-a0f8-7c0148b37230 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.379569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.380350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.380605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.380896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.392182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.394015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.413848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:13.415258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 530/1059] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:13.422217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.432544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dab6cf-6904-485a-8f8f-897bec0891e9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.437789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.438456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.438767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.439035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.439771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:13.440073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.441659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.454425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 530/1060] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:13.460763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.471513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7818a42-3e25-4032-8981-47e6fb406b03 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.476382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.477239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.477451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.477724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.485519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.487569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.502304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:47:13.503492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 531/1061] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:13.509940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.520154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632740-7054-4739-9d17-bd491e163246 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.525278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.525963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.526238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.526534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.527592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:13.528145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.529692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.546990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 531/1062] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:13.553220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.563750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05499358-9098-4ba7-9da1-6fa632ed1a4f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.569193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.569989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.570263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.570487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.581629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.583505 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.601296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:13.602483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 532/1063] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:13.608742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.619019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e141-94a6-4678-b9d2-0dda09cd7357 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.624137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.624790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.625050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.625315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.626049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:13.626354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.627969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.640027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 532/1064] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:13.646382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.656828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020edb0-937b-40ee-80c1-b80a57b06243 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.661612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.662411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.662712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.662974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.670778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.672777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.686430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:47:13.687799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 533/1065] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:13.694040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.704608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04cd67-857f-4a63-9352-cb57b1fe9032 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.710283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.711047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.711328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.711599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.712403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:13.712695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.714716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7779-541f-45e7-90b8-ff104098cfae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.728506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 533/1066] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:47:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:13.735576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:13.747944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf6dc-9c9c-4a5f-99ea-0958edd8250a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:13.753748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:13.754655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:13.754928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:13.755194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/bf26998ac0a849a88ff55d1e94d31e2b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:13.757707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=1a96bba0782248589ec206a1c8c9747e, role_id=bf26998ac0a849a88ff55d1e94d31e2b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:13.760384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9545e3-5136-4614-89e4-ea0515b9b359 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:13.774838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 534/1067] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:47:13 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/1a96bba0782248589ec206a1c8c9747e/roles/bf26998ac0a849a88ff55d1e94d31e2b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:47:14.950598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6381e42-052b-4770-b8e1-b2a7cbceba77 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:14.951157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6381e42-052b-4770-b8e1-b2a7cbceba77 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:14.951157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6381e42-052b-4770-b8e1-b2a7cbceba77 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:14.952914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 534/1068] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:14.958877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:14.959296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:14.959382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:14.977192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:14.978348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:15.038292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 535/1069] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:15.062802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6381e42-052b-4770-b8e1-b2a7cbceba77 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.076774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6381e42-052b-4770-b8e1-b2a7cbceba77 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.082172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.083001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.083279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.083550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.095351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:15.102667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:15.103931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 535/1070] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:15.111080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.120830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d72a4-f37d-48f9-8292-43de08edaf92 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.125994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.126694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.126976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.127251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.128016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:15.128320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:15.129907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:15.138932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 536/1071] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:15.145375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.156360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8df54-c043-42c6-a61f-3e3c53e10a4c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.161650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.162533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.162815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.163085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] PATH_INFO: `/v3/users/9c4cdd919c4e42af96abc040eedae9f1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.177576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4cdd919c4e42af96abc040eedae9f1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:15.179770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:15.181522 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 536/1072] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/users/9c4cdd919c4e42af96abc040eedae9f1 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:15.188027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.198681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70350c0e-9513-423f-823e-d53f6a3f0dc0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.204820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.205476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.205785 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.206057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.214217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:15.216141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:15.224925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 537/1073] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:15.231306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.241948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725109b3-cd65-44e1-b0ac-e51eaf08cfa0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.247392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.248247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.248527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.248806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.250047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:15.252179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bdc2b-db6a-4ef0-b08c-679f2426aebc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:15.253978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 537/1074] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:15.260367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:15.269722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede28320-757d-43e3-b852-8d0cb3215eb4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:15.274778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:15.275412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:15.275689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:15.276013 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:15.276852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b, user.id=9c4cdd919c4e42af96abc040eedae9f1) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:15.277279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:15.279386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32416c-fbfc-4986-a6b1-463abb8db04f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:15.284896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 538/1075] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:15 2021] GET /identity/v3/role_assignments?user.id=9c4cdd919c4e42af96abc040eedae9f1&scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:16.104007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317f13-a959-4be1-9645-1751e7f74d78 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.104598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317f13-a959-4be1-9645-1751e7f74d78 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.104598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317f13-a959-4be1-9645-1751e7f74d78 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.106400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 538/1076] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:16.112589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.113087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.113263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.133099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:16.134304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:16.143895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 539/1077] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:16.168923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317f13-a959-4be1-9645-1751e7f74d78 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.181918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317f13-a959-4be1-9645-1751e7f74d78 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.187030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.187831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.188103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.188376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.198987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:16.206320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 23 11:47:16.207545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 539/1078] 10.222.0.65 () {56 vars in 1141 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:16.214023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.223131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642edb-397a-4807-bebf-bd330890f5a3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.227792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.228447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.228725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.228994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.229754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.230054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.232335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.241913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 540/1079] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:16.248529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.259214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638a2a1-fb8a-4e7a-879c-0b4511e96351 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.264106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.264892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.265191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.265526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.276083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.277976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.295217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:16.296613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 540/1080] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:16.302848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.313401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57690d9-963d-47e2-b0a7-fcb1ceb3838f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.319254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.319904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.320163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.320530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.321153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.321448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.323082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.335873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 541/1081] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:16.342051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.352701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60efb0-e72b-4665-a294-383a1daf88ba admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.358339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.359169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.359448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.359751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.368247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.370290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.384782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 23 11:47:16.385945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 541/1082] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:16.392658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.403688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b021-157b-4d60-9f83-f1f4f0e815ed admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.409369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.410068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.410353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.410666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.411539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.411850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.413743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.434971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 542/1083] 10.222.0.65 () {56 vars in 1154 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:16.441215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.451802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ab18-b58a-476a-b415-329ea06a5a3a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.457353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.458046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.458326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.458586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.466797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.468538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.477420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 542/1084] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:16.483988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.499871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3cbdf-7951-4350-8f72-660ff094e4b1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.504616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.505414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.505703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.505962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.517058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.518913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.535877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:47:16.537044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 543/1085] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:16.543418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.552728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd82f0-c5ef-4ffb-bb6e-67470404b02a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.558101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.559524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.559804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.560078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.560860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.561164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.562796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.575343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 543/1086] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:16.581542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.592235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c750b-9fbb-47dd-acec-10cdc2fcb5ce admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.598062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.598913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.599141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.599424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.607236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.609264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.623539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:47:16.624736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 544/1087] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:16.631440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.642695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f0e9e-c4f2-43ba-b451-153a506bbf25 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.648628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.649308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.649587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.649851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.650708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.651019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.652984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91569adc-7118-4ec6-a1e5-e6a04dfea192 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.667421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 544/1088] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:16.674342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:16.685925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82545b6b-d567-426f-b251-c372023a8b92 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:16.691465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:16.692103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:16.692383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:16.692650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:16.693493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] RBAC: Adding query filter params (role.id=bf26998ac0a849a88ff55d1e94d31e2b, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=1a96bba0782248589ec206a1c8c9747e) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:16.693804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:16.695687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086ec60-fe91-4717-aa64-f9a1a3c2d827 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:16.702226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 545/1089] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:16 2021] GET /identity/v3/role_assignments?user.id=1a96bba0782248589ec206a1c8c9747e&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=bf26998ac0a849a88ff55d1e94d31e2b => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:17.649939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fd8c-1bd6-40cc-a4df-5d6b84c988a1 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.650447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fd8c-1bd6-40cc-a4df-5d6b84c988a1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.650447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fd8c-1bd6-40cc-a4df-5d6b84c988a1 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.653606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 545/1090] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:17.662545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.662994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.663109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.682211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:17.683807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:17.692594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 546/1091] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:47:17.716381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fd8c-1bd6-40cc-a4df-5d6b84c988a1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:17.734388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fd8c-1bd6-40cc-a4df-5d6b84c988a1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:17.740553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:17.741337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.741614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.741881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.753627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:17.760355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:17.761631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 546/1092] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:17.769338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:17.781394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10d36-2f2a-4d25-a815-9706c5e574e4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:17.788666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:17.789395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.789672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.789942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.790881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:17.791336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:17.793392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:17.803356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 547/1093] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:17.813391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:17.828148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b12ab-ba52-40ee-9a84-0012cd73d6b2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:17.834005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:17.835064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.835356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.835639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] PATH_INFO: `/v3/users/9c4cdd919c4e42af96abc040eedae9f1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.836861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4cdd919c4e42af96abc040eedae9f1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:17.839031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:17.841135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 547/1094] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:17 2021] GET /identity/v3/users/9c4cdd919c4e42af96abc040eedae9f1 => generated 285 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:17.847793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:17.859146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d36cf-4c8d-4744-8cef-1e15e18af301 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:17.865942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:17.866902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.867183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.867447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.868775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:17.870991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf44c4-3645-4d52-83cc-f9570bab615d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:17.872661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 548/1095] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:17 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:17.882452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:17.894100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2b0e-f83e-4d7f-b72f-82226172005e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:17.900402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:17.901193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:17.901496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:17.901760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b/users/9c4cdd919c4e42af96abc040eedae9f1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:17.904141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2deab20210ec4d808cb5a90f0eeabe6b, user_id=9c4cdd919c4e42af96abc040eedae9f1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:17.907257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353684af-ee06-44ff-8031-076465e9d209 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:17.924815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 548/1096] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:47:17 2021] PUT /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b/users/9c4cdd919c4e42af96abc040eedae9f1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:47:20.254895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90a44-ef3d-41b1-9124-f90ccc0670f4 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.255493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90a44-ef3d-41b1-9124-f90ccc0670f4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.255493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d90a44-ef3d-41b1-9124-f90ccc0670f4 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.258210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 549/1097] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:20.268720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.269535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.269535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.290495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:20.291738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:20.359522 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 549/1098] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:20.386865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90a44-ef3d-41b1-9124-f90ccc0670f4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.399266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d90a44-ef3d-41b1-9124-f90ccc0670f4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.404017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.404812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.405089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.405358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.416685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:20.423503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:20.424689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 550/1099] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:20.431542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.440814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d05c7f-e2aa-4aaa-9f63-d48c2474e10b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.445466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.446125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.446399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.446688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.447443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:20.447741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:20.449370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:20.458073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 550/1100] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:20.464752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.474773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f635-5abb-46b1-9839-bef5e71324f6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.479421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.480558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.480903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.481196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] PATH_INFO: `/v3/users/9c4cdd919c4e42af96abc040eedae9f1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.482432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4cdd919c4e42af96abc040eedae9f1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:20.484569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:20.486196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 551/1101] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/users/9c4cdd919c4e42af96abc040eedae9f1 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:20.496284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.511317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dac1-f30f-479a-93ab-7bb658b2902c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.518774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.519702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.520065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.520472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.531212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:20.532939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:20.542053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 551/1102] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:20.549546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.563244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99b625-fc1b-47b1-93b4-77c8b26d4ff8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.569183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.570059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.570336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.570637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.571949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:20.574040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee483-15a0-4fce-aea1-612c19715cf9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:20.575711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 552/1103] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:20.586291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:20.596812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62249088-cc9c-4a4d-81ff-fbbbf757ad70 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:20.602897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:20.603534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:20.603813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:20.604083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:20.604922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b, user.id=9c4cdd919c4e42af96abc040eedae9f1) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:20.605348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:20.607199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc1a8d-a821-4c9d-8c3e-124837d3769a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:20.613349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 552/1104] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:20 2021] GET /identity/v3/role_assignments?user.id=9c4cdd919c4e42af96abc040eedae9f1&scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:22.993220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d002-3ca8-439b-a35c-7bd1d2e1d8ac None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:22.997318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d002-3ca8-439b-a35c-7bd1d2e1d8ac None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:22.997318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615d002-3ca8-439b-a35c-7bd1d2e1d8ac None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:22.997318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 553/1105] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:23.004369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:23.005097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:23.005251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:23.026175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:23.027588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:23.036416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 553/1106] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:23.075063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615d002-3ca8-439b-a35c-7bd1d2e1d8ac None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:23.089247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615d002-3ca8-439b-a35c-7bd1d2e1d8ac None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:23.096621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:23.097404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:23.097681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:23.097951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:23.099199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:23.100868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0c57e-635b-4fd8-844b-9511132025ef admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:23.102459 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 554/1107] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:23.108957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:23.118473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc3f73-4d9b-4f65-b4d4-9f4eff980934 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:23.123673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:23.124330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:23.124608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:23.124878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:23.125609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:23.127554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139ca75-f0f4-44b2-930c-a1d23516b171 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:23.154057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 554/1108] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:47:23 2021] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:25.543991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6e0b-b16c-4f74-b634-b85d4b4609c7 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.544895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6e0b-b16c-4f74-b634-b85d4b4609c7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.544895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6e0b-b16c-4f74-b634-b85d4b4609c7 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.547730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 555/1109] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:25 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:25.554667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.555423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.555565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.576504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:25.577728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:25.587588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 555/1110] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:25.613885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6e0b-b16c-4f74-b634-b85d4b4609c7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:25.636958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6e0b-b16c-4f74-b634-b85d4b4609c7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:25.645927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:25.647369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.647814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.648223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] PATH_INFO: `/v3/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.650499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] RBAC: Authorizing `identity:get_role(role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:25.652177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:47:25.652177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:47:25.652177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:47:25.653057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:25.654488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 556/1111] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:25 2021] GET /identity/v3/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 223 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:25.664177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:25.678656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5fe7-d807-4b1a-89d8-e276c0738dfe None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:25.686379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:25.687289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.687568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.687833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] PATH_INFO: `/v3/users/89a16a3c61ee40dda781cfa988a22ac8` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.702894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] RBAC: Authorizing `identity:get_user(user_id=89a16a3c61ee40dda781cfa988a22ac8)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:25.705029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:25.706735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 556/1112] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:25 2021] GET /identity/v3/users/89a16a3c61ee40dda781cfa988a22ac8 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:25.713578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:25.724857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfac7f-5779-4bd3-bff0-7e1c792341f1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:25.731600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:25.732580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.733072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.733497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.747007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:25.748770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:25.757982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 557/1113] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:25.769631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:25.783680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549c0a-9459-45be-8d03-f61e48d96c4c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:25.790226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:25.791119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.791402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.791677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.793238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:25.795337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70973f2-3ea1-4cc8-9df3-b1c14c2c109d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:25.797163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 557/1114] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:25 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:25.804457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:25.814777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814631f-bcb6-4104-9946-8a9d7d691d63 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:25.821431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:25.822065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:25.822339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:25.822628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:25.823464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b, user.id=89a16a3c61ee40dda781cfa988a22ac8) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:25.823814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:25.826643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5607640-afbf-458e-b1e1-2f35b11e9153 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:25.834915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 558/1115] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:25 2021] GET /identity/v3/role_assignments?user.id=89a16a3c61ee40dda781cfa988a22ac8&scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:28.179093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8137-8a94-48fd-8674-b323016b7a40 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.179683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8137-8a94-48fd-8674-b323016b7a40 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.179683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e8137-8a94-48fd-8674-b323016b7a40 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.182404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 558/1116] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:28.192572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.192991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.193162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.215292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:28.216483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:28.226358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 559/1117] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:28.252466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8137-8a94-48fd-8674-b323016b7a40 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:28.267760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e8137-8a94-48fd-8674-b323016b7a40 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:28.272795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:28.273672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.273948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.274216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] PATH_INFO: `/v3/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.275863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] RBAC: Authorizing `identity:get_role(role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:28.277318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:47:28.277318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:47:28.277318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:47:28.278204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:28.279639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 559/1118] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:28 2021] GET /identity/v3/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:28.289873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:28.300472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb252b7-d07d-46a8-931b-eae6ec5e2f3e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:28.307137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:28.308083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.308418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.308623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] PATH_INFO: `/v3/users/89a16a3c61ee40dda781cfa988a22ac8` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.310064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a16a3c61ee40dda781cfa988a22ac8)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:28.312214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:28.313787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 560/1119] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:28 2021] GET /identity/v3/users/89a16a3c61ee40dda781cfa988a22ac8 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:28.320037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:28.330758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d03b-63c9-4137-bf6b-3b0ace6ada00 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:28.337182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:28.338021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.338297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.338598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.340377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:28.342434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ba2a1-29ff-42a0-b21e-b14a67c82337 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:28.344148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 560/1120] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:28 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:28.350784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:28.361969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353675-8773-48d8-bee1-e6d1c2895525 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:28.367846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:28.368733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:28.369013 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:28.369287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b/users/89a16a3c61ee40dda781cfa988a22ac8/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:28.372351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2deab20210ec4d808cb5a90f0eeabe6b, user_id=89a16a3c61ee40dda781cfa988a22ac8, role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:28.375009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418fb2a-2fa1-448d-9279-692f701884d9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:28.390828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 561/1121] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:47:28 2021] PUT /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b/users/89a16a3c61ee40dda781cfa988a22ac8/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:47:30.739196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a13c-ce18-440d-936d-6b74b35f410e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.740343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a13c-ce18-440d-936d-6b74b35f410e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.740343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9a13c-ce18-440d-936d-6b74b35f410e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:30.743373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 561/1122] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:30.749598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.750027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.750115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:30.768565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:30.769746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:30.828924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 562/1123] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:30.854039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9a13c-ce18-440d-936d-6b74b35f410e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:30.868887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9a13c-ce18-440d-936d-6b74b35f410e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:30.874808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:30.875657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.875940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.876219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] PATH_INFO: `/v3/roles/502a0db9c5db4068b57ddb9148ed03fc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:30.877905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] RBAC: Authorizing `identity:get_role(role_id=502a0db9c5db4068b57ddb9148ed03fc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:30.879540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:30.880881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 562/1124] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:30 2021] GET /identity/v3/roles/502a0db9c5db4068b57ddb9148ed03fc => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:30.891375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:30.905014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae522b-b2dc-4842-a58f-94d3ce023770 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:30.913399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:30.914762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.915143 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.915498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] PATH_INFO: `/v3/users/89a16a3c61ee40dda781cfa988a22ac8` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:30.917523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a16a3c61ee40dda781cfa988a22ac8)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:30.921002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:30.923560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 563/1125] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:30 2021] GET /identity/v3/users/89a16a3c61ee40dda781cfa988a22ac8 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:30.930556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:30.942481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743ac7-09a8-4417-be5f-a7a0df51ffb8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:30.949284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:30.949921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.950219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.950493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:30.959501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:30.961233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:30.970422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 563/1126] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:30 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:30.979674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:30.991443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ff1ff-039f-4605-b2b9-3248e3c0af94 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:30.997748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:30.998639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:30.998919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:30.999185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] PATH_INFO: `/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:31.000496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] RBAC: Authorizing `identity:get_project(project_id=2deab20210ec4d808cb5a90f0eeabe6b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:31.002541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c35e-05dc-45e5-ad9c-271895fc7f34 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:31.004227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 564/1127] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:30 2021] GET /identity/v3/projects/2deab20210ec4d808cb5a90f0eeabe6b => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:31.011223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:31.020559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0c9-5b81-4a7c-8650-8d5f233dea1b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:31.026657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:31.027216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:31.027485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:31.027836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:31.028686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] RBAC: Adding query filter params (role.id=502a0db9c5db4068b57ddb9148ed03fc, scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b, user.id=89a16a3c61ee40dda781cfa988a22ac8) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:31.029063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:31.030849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeaa17-8022-4b8e-b3ea-84e15eb116de admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:31.037147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 564/1128] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:31 2021] GET /identity/v3/role_assignments?user.id=89a16a3c61ee40dda781cfa988a22ac8&scope.project.id=2deab20210ec4d808cb5a90f0eeabe6b&role.id=502a0db9c5db4068b57ddb9148ed03fc => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:33.420775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922324-576c-4253-bb64-1cd3e11e2df6 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:33.421360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922324-576c-4253-bb64-1cd3e11e2df6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:33.421360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51922324-576c-4253-bb64-1cd3e11e2df6 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:33.424171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 565/1129] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:33.431232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:33.431732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:33.431732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:33.451824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:33.452998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:33.461060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 565/1130] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:33.486323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51922324-576c-4253-bb64-1cd3e11e2df6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:33.510284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51922324-576c-4253-bb64-1cd3e11e2df6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:33.516371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:33.517156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:33.517435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:33.517707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:33.519067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:33.520775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485b6a-d6a9-459c-b33f-e1c629a69ccc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:33.522383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 566/1131] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:33.528892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:33.538788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea4ac-8942-41b8-97dd-64479e9b658a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:33.545598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:33.546240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:33.546535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:33.546803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:33.547529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:33.549396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331ec5-0cbc-4a77-9e77-39c194965029 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:33.580913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 566/1132] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:47:33 2021] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:35.987545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51b86-f227-4332-bfdb-fcc2dc6e887a None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:35.988397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51b86-f227-4332-bfdb-fcc2dc6e887a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:35.988397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51b86-f227-4332-bfdb-fcc2dc6e887a None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:35.991641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 567/1133] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:35.997623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:35.998068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:35.998181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:36.018046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:36.019254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:36.081018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 567/1134] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:36.107142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51b86-f227-4332-bfdb-fcc2dc6e887a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:36.123090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51b86-f227-4332-bfdb-fcc2dc6e887a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:36.128914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:36.129703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:36.129980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:36.130247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:36.131613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:36.133287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2479a-5288-43c9-b5e9-b1ccd8cc9f77 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:36.134922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 568/1135] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:47:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:36.144706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:36.157223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e3f3-5048-4d30-81fd-33994ca5c6ad None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:36.163828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:36.164482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:36.164757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:36.165021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:36.165741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:36.167982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431b472-6325-4034-88c7-ab13cc28259c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:36.196420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 568/1136] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:47:36 2021] POST /identity/v3/users => generated 286 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:38.615174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e30ba-9bd5-409e-8c72-c0da31f93eb1 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.615992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e30ba-9bd5-409e-8c72-c0da31f93eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.615992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e30ba-9bd5-409e-8c72-c0da31f93eb1 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.618795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 569/1137] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:38.629084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.629542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.629644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.650999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:38.652352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:38.662046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 569/1138] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:38.687718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e30ba-9bd5-409e-8c72-c0da31f93eb1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.707423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e30ba-9bd5-409e-8c72-c0da31f93eb1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.713955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.714775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.715052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.715329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.727714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:38.734874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:38.736100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 570/1139] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:38.747422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.761108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03228201-10ba-425c-9a5e-a7a8825a1599 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.767086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.767748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.768022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.768287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.769036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:38.769305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:38.770960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:38.779352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 570/1140] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:38.786298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.796904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6705fc-3d9c-4470-859e-64bdd7e0b946 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.802546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.803417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.803690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.803957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] PATH_INFO: `/v3/users/40c665eafbe44b528d7152a740e89db7` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.819621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] RBAC: Authorizing `identity:get_user(user_id=40c665eafbe44b528d7152a740e89db7)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:38.821813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:38.823705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 571/1141] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/users/40c665eafbe44b528d7152a740e89db7 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:38.830219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.841616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9358b0-1445-40db-a27b-36cedf30385c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.846931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.847556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.847845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.848101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.856087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:38.857791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:38.866879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 571/1142] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:47:38.873437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.884462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fe045-e29b-41c4-8fa4-bc1a1beece71 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.890832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.891690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.891968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.892341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] PATH_INFO: `/v3/projects/f15d4ba9f31c439e82351590f43caea9` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.893710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] RBAC: Authorizing `identity:get_project(project_id=f15d4ba9f31c439e82351590f43caea9)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:38.895813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1306719-c5cb-4148-8122-0a52f673710b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:38.897463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 572/1143] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/projects/f15d4ba9f31c439e82351590f43caea9 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:38.904170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:38.913131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab182c2-0bf1-43e1-afc4-8774bb96708c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:38.918638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:38.919267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:38.919541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:38.919811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:38.920642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=f15d4ba9f31c439e82351590f43caea9, user.id=40c665eafbe44b528d7152a740e89db7) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:38.920943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:38.922796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950537-88b0-473a-9011-22bdcc7010bc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:38.928293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 572/1144] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:38 2021] GET /identity/v3/role_assignments?user.id=40c665eafbe44b528d7152a740e89db7&scope.project.id=f15d4ba9f31c439e82351590f43caea9&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:41.317321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675944-91af-4025-ac89-fbc25cf5845a None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.318271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675944-91af-4025-ac89-fbc25cf5845a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.318271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc675944-91af-4025-ac89-fbc25cf5845a None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.321045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 573/1145] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:41 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:41.327274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.327721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.327823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.346852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:41.348019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:41.356400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 573/1146] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:41.380904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc675944-91af-4025-ac89-fbc25cf5845a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:41.399945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc675944-91af-4025-ac89-fbc25cf5845a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:41.405942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:41.406775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.407052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.407322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.418542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:41.425196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:41.426364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 574/1147] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:41.436166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:41.445683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027642dc-5e4e-4e07-ae78-d712c00c859c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:41.452409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:41.453073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.453358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.453665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.454431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:41.454763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:41.456358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:41.465371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 574/1148] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:41.473078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:41.491328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e282d10-a71a-4360-ba3a-8667bf263850 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:41.498371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:41.499256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.499530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.499803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] PATH_INFO: `/v3/users/40c665eafbe44b528d7152a740e89db7` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.501142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] RBAC: Authorizing `identity:get_user(user_id=40c665eafbe44b528d7152a740e89db7)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:41.503303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:41.504868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 575/1149] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:41 2021] GET /identity/v3/users/40c665eafbe44b528d7152a740e89db7 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:41.511165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:41.521333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5dd66-0f14-4482-b481-b8dd6491b284 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:41.527497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:41.528342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.528612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.528880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] PATH_INFO: `/v3/projects/f15d4ba9f31c439e82351590f43caea9` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.530192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] RBAC: Authorizing `identity:get_project(project_id=f15d4ba9f31c439e82351590f43caea9)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:41.532249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4a3b8-808b-48e7-80b4-8f412cd613ec admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:41.533884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 575/1150] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:41 2021] GET /identity/v3/projects/f15d4ba9f31c439e82351590f43caea9 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:41.540833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:41.557066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c45a3a-650c-4f81-bb39-5954ed6211fa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:41.563795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:41.564661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:41.564939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:41.565209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] PATH_INFO: `/v3/projects/f15d4ba9f31c439e82351590f43caea9/users/40c665eafbe44b528d7152a740e89db7/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:41.567603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15d4ba9f31c439e82351590f43caea9, user_id=40c665eafbe44b528d7152a740e89db7, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:41.570146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea8aa-e146-40a7-8b7c-5397d8924fe7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:41.585076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 576/1151] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:47:41 2021] PUT /identity/v3/projects/f15d4ba9f31c439e82351590f43caea9/users/40c665eafbe44b528d7152a740e89db7/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:47:43.931500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16032-1908-4099-a430-2d274836e8b7 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:43.932369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16032-1908-4099-a430-2d274836e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:43.932369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16032-1908-4099-a430-2d274836e8b7 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:43.935307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 576/1152] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:43.942225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:43.942973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:43.943161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:43.964254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:43.965447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:44.027715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 577/1153] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:44.071949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16032-1908-4099-a430-2d274836e8b7 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.093986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16032-1908-4099-a430-2d274836e8b7 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.103093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.104133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.104517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.104852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.117978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:44.125256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:44.126430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 577/1154] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:44.137060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.146462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1b5c2-8391-4b7f-a983-e2dafb96341d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.152580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.153239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.153510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.153784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.154543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:44.154878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:44.156478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:44.165453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 578/1155] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:44.172122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.184193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e3b53-aeb6-4b81-95f7-9466f58bb2bd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.189965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.190858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.191140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.191389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] PATH_INFO: `/v3/users/40c665eafbe44b528d7152a740e89db7` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.192635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] RBAC: Authorizing `identity:get_user(user_id=40c665eafbe44b528d7152a740e89db7)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:44.194778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:44.196363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 578/1156] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/users/40c665eafbe44b528d7152a740e89db7 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:44.202899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.213395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860509-7f66-4f76-a520-3bb74fc914f8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.219065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.219686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.219937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.220224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.228725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:44.230548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:44.239677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 579/1157] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:44.247188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.264047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac746a-7e75-477e-a080-e4782a6edb0a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.272972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.274240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.274706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.275099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] PATH_INFO: `/v3/projects/f15d4ba9f31c439e82351590f43caea9` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.276849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f15d4ba9f31c439e82351590f43caea9)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:44.278939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b6d94-a061-492f-927a-2f0573e310b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:44.280604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 579/1158] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/projects/f15d4ba9f31c439e82351590f43caea9 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:44.287597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:44.297517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3ff8-d17b-4910-ada0-f67b7431ad24 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:44.303584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:44.304228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:44.304509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:44.304790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:44.305626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=f15d4ba9f31c439e82351590f43caea9, user.id=40c665eafbe44b528d7152a740e89db7) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:44.305937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:44.307901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e133f-3e68-4216-963e-d65d93bf6d82 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:44.314830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 580/1159] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:44 2021] GET /identity/v3/role_assignments?user.id=40c665eafbe44b528d7152a740e89db7&scope.project.id=f15d4ba9f31c439e82351590f43caea9&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:46.693471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e7ff-5ba9-4f86-8628-cbed2a64a317 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:46.694000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e7ff-5ba9-4f86-8628-cbed2a64a317 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:46.694000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e7ff-5ba9-4f86-8628-cbed2a64a317 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:46.695747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 580/1160] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:46.702950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:46.703683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:46.703845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:46.727222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:46.728406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:46.738327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 581/1161] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:46 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:46.762263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e7ff-5ba9-4f86-8628-cbed2a64a317 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:46.779456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e7ff-5ba9-4f86-8628-cbed2a64a317 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:46.786358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:46.787033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:46.787310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:46.787578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:46.796579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:46.798322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:46.808137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 581/1162] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:46 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:46.818577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:46.832832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf9079-9061-46f2-81ba-460d4f22b0a4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:46.840973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:46.841796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:46.842062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:46.842325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:46.850421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:46.852266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:46.867487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a75d2acb-e4c6-4cf8-9bb1-2b546b9d0bc1 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 23 11:47:46.868609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 582/1163] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:47:46 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:46.876077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:46.889202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7512a-be02-4c4e-820c-9274f65cdd60 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:46.895217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:46.895868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:46.896148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:46.896401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:46.897159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:46.897466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:46.899108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a271c-db56-4202-8726-3d0efae37f93 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:46.907575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 582/1164] 10.222.0.65 () {56 vars in 1136 bytes} [Thu Dec 23 11:47:46 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:49.296970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f8bef-e84c-4288-8029-8d4b775ac956 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:49.297763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f8bef-e84c-4288-8029-8d4b775ac956 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:49.297763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f8bef-e84c-4288-8029-8d4b775ac956 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:49.300565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 583/1165] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:49.310494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf854b-44cc-42bb-8875-d7bad11a5971 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:49.311206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf854b-44cc-42bb-8875-d7bad11a5971 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:49.311451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf854b-44cc-42bb-8875-d7bad11a5971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:49.336392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b9cf854b-44cc-42bb-8875-d7bad11a5971 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:49.337587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b9cf854b-44cc-42bb-8875-d7bad11a5971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:49.347535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 583/1166] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:49.373707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f8bef-e84c-4288-8029-8d4b775ac956 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:49.392063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f8bef-e84c-4288-8029-8d4b775ac956 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:49.397370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:49.398032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:49.398320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:49.398611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:49.399375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:49.400400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:47:49.400400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:47:49.400400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:47:49.401291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1bc2c-6935-4417-9620-5ddd4a6e076e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:49.419211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 584/1167] 10.222.0.65 () {60 vars in 1159 bytes} [Thu Dec 23 11:47:49 2021] POST /identity/v3/domains => generated 267 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:51.788258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a397d6-767e-44a7-b7e8-3c5afc401f3f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:51.789153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a397d6-767e-44a7-b7e8-3c5afc401f3f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:51.789153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a397d6-767e-44a7-b7e8-3c5afc401f3f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:51.792582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 584/1168] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:51.798521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:51.798998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:51.799099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:51.818436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:51.819637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:51.889051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 585/1169] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:51 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:51.915480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a397d6-767e-44a7-b7e8-3c5afc401f3f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:51.935765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a397d6-767e-44a7-b7e8-3c5afc401f3f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:51.942183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:51.943060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:51.943331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:51.943595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] PATH_INFO: `/v3/domains/3ce1560abd464ee08e4af037e8c7014f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:51.955327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3ce1560abd464ee08e4af037e8c7014f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:51.957270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164d0d-341d-428c-8e0f-162c2ff92a05 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:51.958874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 585/1170] 10.222.0.65 () {56 vars in 1204 bytes} [Thu Dec 23 11:47:51 2021] GET /identity/v3/domains/3ce1560abd464ee08e4af037e8c7014f => generated 267 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:51.965561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:51.975343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051443c-09e3-48ef-bd07-27b660a439dd None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:51.982920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:51.983646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:51.983855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:51.984147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:51.984880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:51.987009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba114-29f8-4f21-bb55-6a052fa6fb35 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:52.016752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 586/1171] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:47:51 2021] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:47:54.531091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404782f6-7e21-4f87-a7ef-13b1157b59a6 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:54.531649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404782f6-7e21-4f87-a7ef-13b1157b59a6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:54.531649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404782f6-7e21-4f87-a7ef-13b1157b59a6 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:54.534362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 586/1172] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:54.544272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:54.544717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:54.544807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:54.574367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:54.575591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:54.665104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 587/1173] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:54.700068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404782f6-7e21-4f87-a7ef-13b1157b59a6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:54.712641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404782f6-7e21-4f87-a7ef-13b1157b59a6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:54.717439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:54.718304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:54.718613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:54.718886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] PATH_INFO: `/v3/domains/3ce1560abd464ee08e4af037e8c7014f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:54.720124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=3ce1560abd464ee08e4af037e8c7014f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:54.722068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360142a8-19e8-4f73-bf2a-04dd4b7b7eb3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:54.723782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 587/1174] 10.222.0.65 () {56 vars in 1204 bytes} [Thu Dec 23 11:47:54 2021] GET /identity/v3/domains/3ce1560abd464ee08e4af037e8c7014f => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:54.732366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:54.741598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae1712-812d-4967-bbff-8d419366560e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:54.747786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:54.748446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:54.748719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:54.748987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:54.749702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:54.751638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285fa3f-7ee4-4163-8bc2-8f4a97d37d77 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:54.778130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 588/1175] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:47:54 2021] POST /identity/v3/users => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:47:57.212486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae4a1-3d55-4af2-bf93-76f21c8e7208 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.213093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae4a1-3d55-4af2-bf93-76f21c8e7208 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.213093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ae4a1-3d55-4af2-bf93-76f21c8e7208 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.215000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 588/1176] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:57.222102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.222923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.223064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.250679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:57.251865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:57.262405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 589/1177] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:57.293678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae4a1-3d55-4af2-bf93-76f21c8e7208 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.309469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ae4a1-3d55-4af2-bf93-76f21c8e7208 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.314991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.315774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.316052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.316323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.327386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:57.334192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:57.335398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 589/1178] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:57.342403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.356138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09fca5-ac3d-41c1-833e-ffa51bb38843 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.361725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.362413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.362718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.362987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.363756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:57.364058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:57.365990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:57.376113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 590/1179] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:57.383890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.394943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cb57c-5b04-4421-9081-9fb66beea9eb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.401365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.402295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.402569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.402872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] PATH_INFO: `/v3/users/bdb2fa3ad77743768f44bf62018d9221` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.419092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] RBAC: Authorizing `identity:get_user(user_id=bdb2fa3ad77743768f44bf62018d9221)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:57.421207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:57.422881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 590/1180] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/users/bdb2fa3ad77743768f44bf62018d9221 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:57.429603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.441059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058917c-fab7-4d39-b98f-c849ae5b512e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.447685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.448730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.449011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.449282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.458549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:57.460328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:57.469976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 591/1181] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:47:57.480026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.490757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f8d57-f914-4faa-9d82-b6097f79dc38 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.496846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.497697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.497996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.498264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] PATH_INFO: `/v3/projects/3ed62ec20c3e43508314f7a5ced8920e` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.499677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ed62ec20c3e43508314f7a5ced8920e)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:57.501691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a1902-94cc-48cf-ab3e-54f2f24458f7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:57.503361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 591/1182] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/projects/3ed62ec20c3e43508314f7a5ced8920e => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:47:57.509886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:57.524930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021b2c-b677-4d05-9c29-4ad612eb188f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:57.534487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:57.535090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:57.535487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:57.535869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:57.537033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=3ed62ec20c3e43508314f7a5ced8920e, user.id=bdb2fa3ad77743768f44bf62018d9221) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:47:57.537417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:47:57.540318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802efe-22e3-4fbb-b3e5-71689111665c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:47:57.546837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 592/1183] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:47:57 2021] GET /identity/v3/role_assignments?user.id=bdb2fa3ad77743768f44bf62018d9221&scope.project.id=3ed62ec20c3e43508314f7a5ced8920e&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:47:59.878233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33753738-ecb5-4ea1-90f9-f6ab3698feb1 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:59.879172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33753738-ecb5-4ea1-90f9-f6ab3698feb1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:59.879356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33753738-ecb5-4ea1-90f9-f6ab3698feb1 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:59.882371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 592/1184] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:47:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:47:59.890241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:59.890676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:59.890839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:59.910237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:47:59.911487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:47:59.920569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 593/1185] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:47:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:47:59.944907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33753738-ecb5-4ea1-90f9-f6ab3698feb1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:47:59.959956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33753738-ecb5-4ea1-90f9-f6ab3698feb1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:47:59.965595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:47:59.966371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:47:59.966682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:47:59.966965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:47:59.978956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:47:59.985904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:47:59.987057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 593/1186] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:47:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:47:59.993764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:00.003617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3307-d484-4a70-9231-205ce47397d5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:00.009366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:00.010067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:00.010399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:00.010787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:00.011568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:48:00.011875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:00.013468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:00.022763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 594/1187] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:47:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:00.030017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:00.046818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69534-4562-4bc6-a33c-6c57b430e237 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:00.053198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:00.054327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:00.054720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:00.054999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] PATH_INFO: `/v3/users/bdb2fa3ad77743768f44bf62018d9221` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:00.056427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] RBAC: Authorizing `identity:get_user(user_id=bdb2fa3ad77743768f44bf62018d9221)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:00.058969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:00.060596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 594/1188] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:48:00 2021] GET /identity/v3/users/bdb2fa3ad77743768f44bf62018d9221 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:00.070490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:00.085946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d02e2-0780-4e77-9359-58e8a2bc2326 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:00.092591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:00.093442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:00.093718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:00.093989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] PATH_INFO: `/v3/projects/3ed62ec20c3e43508314f7a5ced8920e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:00.095451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ed62ec20c3e43508314f7a5ced8920e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:00.097506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14235cf4-d3c6-4201-bb90-2c4d3541d0c6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:00.099199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 595/1189] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:48:00 2021] GET /identity/v3/projects/3ed62ec20c3e43508314f7a5ced8920e => generated 361 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:00.105992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:00.116929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0484a-59fb-489a-9627-dfbaf1a38552 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:00.122318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:00.123222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:00.123498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:00.123772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] PATH_INFO: `/v3/projects/3ed62ec20c3e43508314f7a5ced8920e/users/bdb2fa3ad77743768f44bf62018d9221/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:00.125799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed62ec20c3e43508314f7a5ced8920e, user_id=bdb2fa3ad77743768f44bf62018d9221, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:00.128475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddac1b5-72ac-42ae-ba6a-5c4bec092606 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:00.142737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 595/1190] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:48:00 2021] PUT /identity/v3/projects/3ed62ec20c3e43508314f7a5ced8920e/users/bdb2fa3ad77743768f44bf62018d9221/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:48:02.447767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc90c-eac1-4776-bb90-f649df952910 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.448541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc90c-eac1-4776-bb90-f649df952910 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.448541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebc90c-eac1-4776-bb90-f649df952910 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.450099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 596/1191] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:48:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:48:02.456981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.457418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.457534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.480134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:48:02.481321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:48:02.548290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 596/1192] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:48:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:48:02.573047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc90c-eac1-4776-bb90-f649df952910 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.586914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebc90c-eac1-4776-bb90-f649df952910 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.592457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.593248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.593526 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.593793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.604160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:48:02.610916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:48:02.612065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 597/1193] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:48:02.622567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.636593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93e40-86f0-462b-8366-045d8e6bbfcb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.642655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.643479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.643872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.644227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.645184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:48:02.645498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:02.647346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:02.657905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 597/1194] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:02.665354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.681872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3fe6-8d13-43dd-9555-10d78aef5a48 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.690221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.691320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.691703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.692092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] PATH_INFO: `/v3/users/bdb2fa3ad77743768f44bf62018d9221` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.693975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] RBAC: Authorizing `identity:get_user(user_id=bdb2fa3ad77743768f44bf62018d9221)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:02.697346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:02.699356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 598/1195] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/users/bdb2fa3ad77743768f44bf62018d9221 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:02.708803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.725679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1d69b-f691-4404-af32-8ea6ca9a111a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.730500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.731150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.731424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.731695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.740635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:02.742427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:02.752154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 598/1196] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:48:02.759029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.769568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b8fc3-5684-4c01-af27-3990a3e13139 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.776280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.777140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.777419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.777688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] PATH_INFO: `/v3/projects/3ed62ec20c3e43508314f7a5ced8920e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.779049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ed62ec20c3e43508314f7a5ced8920e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:02.781084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a93c2-d689-47f9-b59e-00cd942c5542 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:02.782751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 599/1197] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/projects/3ed62ec20c3e43508314f7a5ced8920e => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:48:02.789278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:48:02.799137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63374ef-3b12-4fb0-837c-716e145c6d0b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:48:02.805373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:48:02.806018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:48:02.806300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:48:02.806585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:48:02.807631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=3ed62ec20c3e43508314f7a5ced8920e, user.id=bdb2fa3ad77743768f44bf62018d9221) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:48:02.807854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:48:02.809670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6079-7e58-4578-b38b-a93a64dc6820 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:48:02.816720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 599/1198] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:48:02 2021] GET /identity/v3/role_assignments?user.id=bdb2fa3ad77743768f44bf62018d9221&scope.project.id=3ed62ec20c3e43508314f7a5ced8920e&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:02.226985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc22e-bc73-4366-809b-d44e7451dde4 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:02.226985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc22e-bc73-4366-809b-d44e7451dde4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:02.226985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc22e-bc73-4366-809b-d44e7451dde4 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:02.228191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 600/1199] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:02.239758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:02.240359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:02.240524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:02.267610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:02.269385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:02.281085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 600/1200] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:02.320310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cc22e-bc73-4366-809b-d44e7451dde4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:02.337793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cc22e-bc73-4366-809b-d44e7451dde4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:02.342956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:02.349155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:02.349155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:02.349155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:02.361732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:02.363966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:02.385035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:02.386981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 601/1201] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:02.396856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:02.413010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a501886-8eac-4e8b-bd8e-107302126231 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:02.419139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:02.419889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:02.420117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:02.420447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:02.421199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:02.421580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:02.423485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf2c89-ad16-4442-82b7-05956c2f4ec0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:02.438711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 601/1202] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:02.445063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:02.461592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e74804-14cf-4ef3-8f29-68bc8683605e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:02.471869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:02.472720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:02.473021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:02.473335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:02.474253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:02.476659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd6a32-66da-43b1-be71-6601b15da5c0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:02.509836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 602/1203] 10.222.0.65 () {60 vars in 1153 bytes} [Thu Dec 23 11:49:02 2021] POST /identity/v3/users => generated 251 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:49:05.382985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf0f8-01ce-4a8c-8aa0-6b68496a4d78 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.383555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf0f8-01ce-4a8c-8aa0-6b68496a4d78 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.383555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbf0f8-01ce-4a8c-8aa0-6b68496a4d78 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.386350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 602/1204] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:05.393955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.394675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.394675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.417501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:05.419266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:05.428450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 603/1205] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:05.455579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbf0f8-01ce-4a8c-8aa0-6b68496a4d78 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.470372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbf0f8-01ce-4a8c-8aa0-6b68496a4d78 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.475753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.476642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.477049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.477406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.490868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:05.498797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:49:05.500436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 603/1206] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:05.507459 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.519219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89393264-eb91-4b86-bc92-737f0193e12c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.525163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.526326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.526638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.526921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.527961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:05.528350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.530345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.540917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 604/1207] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:05.547446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.560320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604da63-8701-4add-b830-31b9f451dd11 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.566101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.567058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.567520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.567708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.582735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.584683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.605163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:05.613359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 604/1208] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:05.613498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.627574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d495c-2502-4993-bb23-8b5a7d80a87f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.633640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.634367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.634692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.634967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.635698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:05.636013 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.638077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.658563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 605/1209] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:05.663753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.675706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0118-0467-400f-8d90-3cee576efa7a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.681886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.683014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.683359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.683689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.693057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.695163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.711212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:05.718026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 605/1210] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:05.719910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.734257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf303-17b6-49f2-8dd7-ad2dfe4d9523 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.740914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.741681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.741951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.742273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.743196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:05.743522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.745414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.776203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 606/1211] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:05.777458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.788795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8f476-bcfb-40b8-b70c-3fa08e403fe7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.795265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.796016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.796376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.796672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.806749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.809115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.820986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 606/1212] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:49:05.827506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.845225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ede5f-d01f-4c47-8cff-d9366095e791 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.851490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.852371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.852849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.853022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.866402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.868887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.889983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:05.891782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 607/1213] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:05.898422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.913173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175c4c0-1403-4364-9a5b-9b11f1b5c6c9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.920776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.921552 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.921830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.922103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.922973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:05.923268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.925117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.940187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 607/1214] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:05.946839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:05.957431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505daf-049f-4d2f-a16a-213c4e4b6641 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:05.962726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:05.963545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:05.963878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:05.964292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:05.973954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:05.976886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:05.991937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:05.993615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 608/1215] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:06.001200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:06.012416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969308cb-6d8f-4d90-870f-3f216508e9a1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:06.017699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:06.018609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:06.019093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:06.019375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:06.020345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:06.020704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:06.023003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c1276-a97a-4844-8295-b2c10897711c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:06.037705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 608/1216] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:06.047226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:06.061183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb889d-0211-45bc-be55-9ea49a3160e2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:06.066293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:06.067328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:06.067824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:06.068319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:06.069935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=c6966386b0f049b69806233e9a0157ed) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:06.070325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:06.072782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524daba2-240a-4520-93d7-ff967a12e29f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:06.083136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 609/1217] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:49:06 2021] GET /identity/v3/role_assignments?user.id=c6966386b0f049b69806233e9a0157ed&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:08.565658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bcb22-52d6-4d52-837a-176204cbec30 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.566294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bcb22-52d6-4d52-837a-176204cbec30 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.566294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bcb22-52d6-4d52-837a-176204cbec30 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.568032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 609/1218] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:08.575272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.575754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.575863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.594610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:08.595822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:08.604736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 610/1219] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:08.631025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bcb22-52d6-4d52-837a-176204cbec30 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.645905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bcb22-52d6-4d52-837a-176204cbec30 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.651546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.652610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.652993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.653168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.665892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:08.674291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:49:08.675873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 610/1220] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:08.687419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.697522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00f2e6-960e-4ddf-aaeb-821173d688f5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.702057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.702870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.703157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.703431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.704197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:08.704501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.706119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.714832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 611/1221] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:08.722300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.734187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30061-bd47-47d1-aa9b-5a91f97b380a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.740240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.741121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.741391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.741700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.755318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.757389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.778119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:08.779508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 611/1222] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:08.786445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.797160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eefb7-2b03-454c-9487-c66767e20398 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.802494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.803216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.803548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.803902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.804744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:08.805080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.806876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.822893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 612/1223] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:08.828913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.840097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55980af5-8d02-4e4e-8e90-453118ecddc6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.845450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.846410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.846860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.847181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.857914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.860397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.877121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:08.878374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 612/1224] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:08.886083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.896866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bba622-a655-4102-98ac-4767bbac259c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.903067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.903745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.904039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.904288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.905150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:08.905456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.907401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.927022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 613/1225] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:08.933891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.944098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b191c0-24fd-45bd-b4cc-ba65feb21514 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:08.949269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:08.950075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:08.950359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:08.950644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:08.961566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:08.963609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:08.980708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:08.981896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 613/1226] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:08.988538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:08.999332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ddd46-6cce-40ee-8fbe-eff9fa381c84 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:09.004580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:09.005395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:09.005714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:09.006091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:09.007069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:09.007493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:09.009596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:09.025847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 614/1227] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:09.032765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:09.045079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f9a5-75f7-4996-b03c-832e885c7053 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:09.051856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:09.052951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:09.053350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:09.053680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:09.062886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:09.065445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:09.081172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:09.082408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 614/1228] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:09.089528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:09.102137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a4e2-d295-498e-85ee-4c4cff86951d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:09.108149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:09.108808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:09.109091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:09.109365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:09.110162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:09.110472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:09.113117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fa153-8c4b-44bb-8eb2-3566d27a2ff7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:09.128487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 615/1229] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:09.135407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:09.147085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92666-c37b-4dc1-a3d4-d6a2bb8d0ced admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:09.153158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:09.154107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:09.154388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:09.154765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/c6966386b0f049b69806233e9a0157ed/roles/6a785545f48848408f0de77ce29c1964` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:09.171757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=c6966386b0f049b69806233e9a0157ed, role_id=6a785545f48848408f0de77ce29c1964)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:09.174663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b68cde-f87c-43ae-a421-7ccf8b1d3fc9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:09.190441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 615/1230] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:49:09 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/c6966386b0f049b69806233e9a0157ed/roles/6a785545f48848408f0de77ce29c1964 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:49:11.651887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751747-9eb5-4283-97a3-41c2a0ffebb0 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.652528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751747-9eb5-4283-97a3-41c2a0ffebb0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.652528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5751747-9eb5-4283-97a3-41c2a0ffebb0 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.654144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 616/1231] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:11.660765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.661223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.661470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.682619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:11.684173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:11.747091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 616/1232] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:11.771242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5751747-9eb5-4283-97a3-41c2a0ffebb0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:11.786557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5751747-9eb5-4283-97a3-41c2a0ffebb0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:11.791045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:11.791845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.792124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.792393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.802986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:11.810110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 23 11:49:11.811342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 617/1233] 10.222.0.65 () {56 vars in 1123 bytes} [Thu Dec 23 11:49:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:11.818721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:11.827891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261fe5-c16f-43da-b8a0-4284b2305572 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:11.832463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:11.833113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.833401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.833663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.834418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:11.834754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:11.836332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:11.844663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 617/1234] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Dec 23 11:49:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:11.851517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:11.863588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4e2-1d58-4625-bccd-4bc2ac0ea6d3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:11.869333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:11.870147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.870392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.870702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.881992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:11.884697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:11.907379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:11.908540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 618/1235] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:11.915520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:11.927150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a6ee4-fbc2-4fdc-91dc-a8d6ace97bf2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:11.932785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:11.933564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.933887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.934206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.935004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:11.935327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:11.937027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:11.952059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 618/1236] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:11.958348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:11.968352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705075b9-14fe-4fe3-9670-f157dbe5cb31 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:11.973033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:11.973820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:11.974097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:11.974359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:11.983022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:11.985133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.000043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:12.001238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 619/1237] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:12.007665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.018219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3b12-f3ba-4776-aa1a-75e39bcb0fa2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.023070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.023732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.024012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.024279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.025199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:12.025500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.027550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.047336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 619/1238] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:12.054218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.065369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d67a-198b-48ec-9ac4-f794221f85c9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.071033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.071733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.072006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.072272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.080756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.082502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.091822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 620/1239] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:49:12.099260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.109914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3ae7-c332-43bf-98fd-2b004d2c4c98 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.117534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.118635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.118767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.119030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.131017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.133397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.153802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:12.155029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 620/1240] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:12.161805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.170814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbfa76-9f80-4eed-bc0a-f9de5aea6cac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.175325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.175970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.176243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.176508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.177235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:12.177530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.179220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.190853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 621/1241] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:12.197187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.207796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320016d2-518c-467f-8e5c-134c156f6db0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.213287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.214276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.214628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.214912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.223117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.225130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.240564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:12.242300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 621/1242] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:12.249189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.260763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51c8d-01dc-4e99-b148-20879ed1ffef admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.266838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.267502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.267786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.268057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.268858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:12.269168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.271074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77025671-d9ec-4b75-a76f-c7b217fdc210 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.284523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 622/1243] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:12.295085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:12.307938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e44d3-a3c9-48eb-81fb-72e806a235a8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:12.313179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:12.313887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:12.314194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:12.314471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:12.315365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] RBAC: Adding query filter params (role.id=6a785545f48848408f0de77ce29c1964, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=c6966386b0f049b69806233e9a0157ed) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:12.315739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:12.317814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93971a5c-dce6-4237-a293-b7090985ab1f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:12.325041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 622/1244] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:49:12 2021] GET /identity/v3/role_assignments?user.id=c6966386b0f049b69806233e9a0157ed&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=6a785545f48848408f0de77ce29c1964 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:14.869360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7deec-4335-48f9-b4a0-f9e1eb06e64f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:14.869977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7deec-4335-48f9-b4a0-f9e1eb06e64f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:14.869977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7deec-4335-48f9-b4a0-f9e1eb06e64f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:14.872188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 623/1245] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:14.879662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:14.880155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:14.880250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:14.901253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:14.902627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:14.912622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 623/1246] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:14.939425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7deec-4335-48f9-b4a0-f9e1eb06e64f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:14.953499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7deec-4335-48f9-b4a0-f9e1eb06e64f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:14.958696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:14.959697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:14.959974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:14.960242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:14.972282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:14.979967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:49:14.981432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 624/1247] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:49:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:14.988545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:14.999495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb792891-ea2d-4487-a5be-93dcf0e59311 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.005521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.006272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.006753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.007048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.007953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.008274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.010247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.021866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 624/1248] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:49:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:15.028860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.040064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723356ae-a99b-4a7f-95bd-ef5e6a970bb9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.046199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.047123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.047515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.047816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.060318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.062381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.085599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:15.087147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 625/1249] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:15.094440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.107362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9023d-cff9-40b9-9d88-2459d80d60df admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.112110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.112775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.113087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.113532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.114805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.115239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.117137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.133455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 625/1250] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:15.140076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.153384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfb362-6e2c-414f-ae0e-3d1dd7765aab admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.158982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.159790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.160071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.160345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.169925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.172747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.188720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:15.190036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 626/1251] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:15.197264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.210073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3d2ff-cf77-4839-ba40-1e73120540e4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.215689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.216812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.217203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.217524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.219074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.219560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.221700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.241429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 626/1252] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:15.248356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.259828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afe907-e464-4a13-b018-f95b4380b92a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.266224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.267507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.267811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.268227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.278991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.281161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.292858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 627/1253] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:49:15.300642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.311594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e2f97-56e3-49cc-a787-a6d89805fb8c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.316575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.317377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.317654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.317963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.330146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.332380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.353519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:15.355245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 627/1254] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:15.361575 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.372393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c83a-d8c4-4bfc-b4cc-bbd3e0c34210 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.377281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.377948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.378216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.378483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.379314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.379670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.381268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.394786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 628/1255] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:15.401832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.412775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045789-00dc-4859-b016-27091ce0d7af admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.417831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.418659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.418936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.419208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.426303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.428285 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.442997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:15.444397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 628/1256] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:15.450928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.460864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0db09-f53c-4653-aeb9-a820dfe79440 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.466165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.466833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.467109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.467378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.468172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.468473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.470313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c46ae-5c32-404a-8cec-3882375b0a49 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.486478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 629/1257] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:15.495082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:15.506844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761909d9-c6ca-464c-aab3-7830e43db48f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:15.512894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:15.513551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:15.513826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:15.514087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:15.514963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=c6966386b0f049b69806233e9a0157ed) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:15.515286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:15.517133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde6a5b-e23d-4ea8-8973-abdbe7e397ad admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:15.523670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 629/1258] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:49:15 2021] GET /identity/v3/role_assignments?user.id=c6966386b0f049b69806233e9a0157ed&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:17.991666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19742-b043-48a1-85b5-e1dff17f764c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:17.991666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19742-b043-48a1-85b5-e1dff17f764c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:17.991666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19742-b043-48a1-85b5-e1dff17f764c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:17.991666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 630/1259] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:17.998712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:17.999292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:17.999406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.018490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:18.019956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:18.029418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 630/1260] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:18.054090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19742-b043-48a1-85b5-e1dff17f764c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.068161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19742-b043-48a1-85b5-e1dff17f764c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.073598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.074504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.074807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.075099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.087426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:18.094968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:49:18.097855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 631/1261] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:18.103597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.113556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967a10-b420-4e52-a529-d8b540fbf6bd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.119257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.119994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.120344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.120634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.121495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:18.121848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.123737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.134393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 631/1262] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:18.141171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.152402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622ecd4-da54-4135-8cf1-9f97d02e9e1f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.157679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.158617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.158991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.159356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.170857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.172752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.190670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:18.196990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 632/1263] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:18.199317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.210684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7cb0c-f04c-44c9-8dd1-fe5a375c707a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.217068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.217924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.218273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.218643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.219493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:18.219782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.221680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.235957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 632/1264] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:18.242677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.253195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adc9b8-2217-420b-901f-a5fa06a8a448 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.258951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.259739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.259995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.260280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.269083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.271228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.285160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:18.286371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 633/1265] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:18.293027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.303119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2be9-f476-4f57-95c4-fadb69dc0784 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.308344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.309005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.309281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.309553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.310404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:18.310734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.312697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.331451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 633/1266] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:18.337784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.347750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298cd6-f1ec-45ef-8281-cf1c7c362ea2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.352458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.356619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.356619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.356619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.370797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.372804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.392130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:18.393394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 634/1267] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:18.400137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.412644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96e65c-f8fc-46ae-b9a1-3cacd192b7a7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.419142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.419889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.420240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.420520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.421317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:18.421639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.423379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.438564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 634/1268] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:18.443816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.455198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e680278-0b7a-4286-99cb-d42a01a2a5b1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.460252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.461215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.461498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.461774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.471364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.473638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.489600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:18.490838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 635/1269] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:18.497861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.508194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb8a38-fe81-4d23-a62b-297fde404411 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.513928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.514629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.514963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.515275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.516058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:18.516426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.518253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945c53c-87a6-4aae-ba0b-ad79e0181d1d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.531458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 635/1270] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:18.538322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:18.549025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1746c87-7983-468f-97a2-d6992c4738ff admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:18.554061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:18.554970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:18.555249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:18.555520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] PATH_INFO: `/v3/projects/cfa91e246db04e09aa78ae146a965727/users/c6966386b0f049b69806233e9a0157ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:18.557515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa91e246db04e09aa78ae146a965727, user_id=c6966386b0f049b69806233e9a0157ed, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:18.560378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0c3c1-6ebc-45f1-bdac-3f691ee7ef2f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:18.574556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 636/1271] 10.222.0.65 () {58 vars in 1460 bytes} [Thu Dec 23 11:49:18 2021] PUT /identity/v3/projects/cfa91e246db04e09aa78ae146a965727/users/c6966386b0f049b69806233e9a0157ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:49:20.982396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893163b-2cec-4dfb-91f6-5a38cbc87792 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:20.983263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893163b-2cec-4dfb-91f6-5a38cbc87792 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:20.983263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893163b-2cec-4dfb-91f6-5a38cbc87792 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:20.986124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 636/1272] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:20.994993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:20.995429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:20.995536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.013384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:21.014605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:21.071957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 637/1273] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:21.102871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893163b-2cec-4dfb-91f6-5a38cbc87792 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.117474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893163b-2cec-4dfb-91f6-5a38cbc87792 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.122881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.123673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.123955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.124231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.135894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 23 11:49:21.142784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 23 11:49:21.143972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 637/1274] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:21.151470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.165647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78687-5f82-415f-9ab2-c2e5086e59d1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.174981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.175940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.176295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.176668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.177820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.178230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.180761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.197229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 638/1275] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:21.206720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.217517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5baaf-f182-4dc5-95ff-654f840bdb35 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.223232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.224217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.224501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.224780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.235574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.237329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.254280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:21.255433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 638/1276] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:21.261908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.272959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c58ae-c2de-46ae-97b8-52968b085e50 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.278662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.279310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.279583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.279846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.280567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.280867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.282443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.296081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 639/1277] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:21.302697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.313899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282fc8-e323-495d-b803-4f1aa34ed108 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.319921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.320719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.320999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.321421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.330121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.332163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.349026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 23 11:49:21.350185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 639/1278] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:21.357615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.368261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e014c16-2ebd-40a6-b350-649f5b631474 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.374143 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.374833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.375115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.375384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.376237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.376550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.378415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.397472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 640/1279] 10.222.0.65 () {56 vars in 1164 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:21.404235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.415226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce906a-3a77-4885-8933-364eaf633135 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.420234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.420884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.421161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.421432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.430034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.432148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.441828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 640/1280] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:49:21.448714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.459131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd81d04-9025-43aa-9f17-83ecd9062a21 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.465048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.465847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.466122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.466384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.477725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.479700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.497804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 23 11:49:21.498964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 641/1281] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:21.509126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.519064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9d0a-8cb1-4d68-8a16-31f5ea055392 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.524740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.525424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.525696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.526162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.526951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.527254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.528826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.540580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 641/1282] 10.222.0.65 () {56 vars in 1130 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:21.546728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.557146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4baca-8336-4863-9582-efb1870f6ec9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.562374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.563183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.563456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.563731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.571352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.573321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.586413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING keystone.server.flask.application [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 23 11:49:21.587564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 642/1283] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:21.594025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.604490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11109d-a4ad-4bbe-bd46-776bdbd9c89d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.609873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.610540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.610829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.611099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.611879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.612177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.614327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769b63e-b065-4df1-bdab-e1344a8270d8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.629138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 642/1284] 10.222.0.65 () {56 vars in 1169 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:21.636648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:21.651390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7d9e3-3a12-41b0-b542-b25747f322b9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:21.660679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:21.661678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:21.662110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:21.662558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:21.663792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] RBAC: Adding query filter params (role.id=00fb2e201ac64cd3b6dd6add80bbad1a, scope.project.id=cfa91e246db04e09aa78ae146a965727, user.id=c6966386b0f049b69806233e9a0157ed) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:21.664301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:21.666838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981967e8-0138-4d88-b8ee-9bf7a012c9a2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:21.673701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 643/1285] 10.222.0.65 () {56 vars in 1395 bytes} [Thu Dec 23 11:49:21 2021] GET /identity/v3/role_assignments?user.id=c6966386b0f049b69806233e9a0157ed&scope.project.id=cfa91e246db04e09aa78ae146a965727&role.id=00fb2e201ac64cd3b6dd6add80bbad1a => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:24.120852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd846-eec5-4ff0-a18f-9ceb3e988eb0 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:24.121773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd846-eec5-4ff0-a18f-9ceb3e988eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:24.121773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfd846-eec5-4ff0-a18f-9ceb3e988eb0 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:24.124656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 643/1286] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:24.133982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:24.134430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:24.134568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:24.153758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:24.154994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:24.163512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 644/1287] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:49:24.187622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd846-eec5-4ff0-a18f-9ceb3e988eb0 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:24.202189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfd846-eec5-4ff0-a18f-9ceb3e988eb0 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:24.207175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:24.207957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:24.208228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:24.208498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:24.209158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:24.210777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:24.222131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 23 11:49:24.223236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 644/1288] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:49:24 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:24.230597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:24.245072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa65c6-557d-4231-9041-f38a827a01f0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:24.251520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:24.252172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:24.252450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:24.252710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:24.253442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:24.253744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:24.255378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47300806-a415-4eeb-b15f-c5a4fd3dbd65 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:24.261393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 645/1289] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Dec 23 11:49:24 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:49:24.268298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:24.281993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc100692-df6f-4d31-acc2-5b57cea5340e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:24.287509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:24.288164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:24.288443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:24.288714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] PATH_INFO: `/v3/services` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:24.289431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:24.289736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:24.291426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc5bb-cd24-4ab8-8089-25c14c070ca5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:24.296556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 645/1290] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Dec 23 11:49:24 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:26.688258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257b97-ac93-4962-bd16-6aad2cc36b13 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:26.688786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257b97-ac93-4962-bd16-6aad2cc36b13 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:26.688786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257b97-ac93-4962-bd16-6aad2cc36b13 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:26.690630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 646/1291] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:26.700647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eeb10-a80c-4c54-b023-68d124a9d2fd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:26.701118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eeb10-a80c-4c54-b023-68d124a9d2fd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:26.701208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eeb10-a80c-4c54-b023-68d124a9d2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:26.731003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-850eeb10-a80c-4c54-b023-68d124a9d2fd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:26.732207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-850eeb10-a80c-4c54-b023-68d124a9d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:26.742632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 646/1292] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:26.773306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07257b97-ac93-4962-bd16-6aad2cc36b13 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:26.795263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07257b97-ac93-4962-bd16-6aad2cc36b13 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:26.804068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:26.804996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:26.805282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:26.805555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:26.806583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:26.809076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9acb8-014a-4421-be45-dab0ae60945d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:26.827933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 647/1293] 10.222.0.65 () {60 vars in 1162 bytes} [Thu Dec 23 11:49:26 2021] POST /identity/v3/services => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:49:29.207463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dbb7-9673-403a-b550-f39c1e5e0500 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.208359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dbb7-9673-403a-b550-f39c1e5e0500 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.208359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528dbb7-9673-403a-b550-f39c1e5e0500 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.211281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 647/1294] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:29.217137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.217592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.217686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.236593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:29.237774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:29.258179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 648/1295] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:29 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:29.281990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528dbb7-9673-403a-b550-f39c1e5e0500 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:29.297570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528dbb7-9673-403a-b550-f39c1e5e0500 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:29.303157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:29.303992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.304242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.304546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.305202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:29.308318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:29.322096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 23 11:49:29.323323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 648/1296] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:49:29 2021] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 23 11:49:29.330819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:29.342537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7a21-1c28-4861-9a34-cbdacc1335b6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:29.348743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:29.349456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.349749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.350014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.350771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:29.351072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:29.353310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:29.360971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 649/1297] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Dec 23 11:49:29 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:29.368523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:29.378958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54ff65-d90f-4d86-b33a-60f53c842ae8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:29.384764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:29.385512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.385799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.386253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.387738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] RBAC: Adding query filter params (interface=public, service_id=690eba54e9b447bbb22e85b80b4613a8, region_id=RegionOne) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:29.388164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:29.390915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f49802-f066-4c72-a6c5-640570138c6d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:29.398247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 649/1298] 10.222.0.65 () {56 vars in 1272 bytes} [Thu Dec 23 11:49:29 2021] GET /identity/v3/endpoints?service_id=690eba54e9b447bbb22e85b80b4613a8&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:29.404883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:29.417107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40081cd-febf-4e05-ae74-b3c94c236e02 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:29.422722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:29.423387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:29.423652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:29.423929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:29.424622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:29.426265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879e21c-395d-471f-9459-fd93b28cec67 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:29.433893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 650/1299] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:49:29 2021] GET /identity/v3/services => generated 2191 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:49:31.824902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c0eb-80fb-4b40-b454-5ead89a1addf None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:31.825864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c0eb-80fb-4b40-b454-5ead89a1addf None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:31.825864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c0eb-80fb-4b40-b454-5ead89a1addf None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:31.828667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 650/1300] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:49:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:49:31.838645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:31.839067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:31.839245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:31.864685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:49:31.865887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:49:31.874179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 651/1301] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:49:31 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:49:31.908396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3c0eb-80fb-4b40-b454-5ead89a1addf None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:31.924801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3c0eb-80fb-4b40-b454-5ead89a1addf None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:31.931250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:31.932274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:31.932611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:31.933046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:31.934165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:31.936430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:31.949101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING keystone.server.flask.application [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 23 11:49:31.950252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 651/1302] 10.222.0.65 () {56 vars in 1138 bytes} [Thu Dec 23 11:49:31 2021] GET /identity/v3/services/placement => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 23 11:49:31.956938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:31.966391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfedd47-16da-46f5-8dd3-600b6c96f830 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:31.972212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:31.972857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:31.973131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:31.973395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] PATH_INFO: `/v3/services` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:31.974115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:49:31.974410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:31.976023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52479f-8bad-48d8-8598-1fa40823517a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:31.981655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 652/1303] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Dec 23 11:49:31 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:49:31.990853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:49:32.001218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dbcc6-a399-4ba5-a5f0-e120ea422bb8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:49:32.006300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:49:32.006968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:49:32.007255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:49:32.007527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:49:32.008618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:49:32.010105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321e871-c1be-498c-ac44-040779174463 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:49:32.035133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 652/1304] 10.222.0.65 () {60 vars in 1165 bytes} [Thu Dec 23 11:49:31 2021] POST /identity/v3/endpoints => generated 331 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:50:36.627110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:36.628134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:36.628607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:36.630608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 653/1305] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:36.637154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ceffa-a14c-4f52-9636-6b76cc4520d0 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:36.638098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ceffa-a14c-4f52-9636-6b76cc4520d0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:36.638599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ceffa-a14c-4f52-9636-6b76cc4520d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:36.725482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-872ceffa-a14c-4f52-9636-6b76cc4520d0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:36.726722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-872ceffa-a14c-4f52-9636-6b76cc4520d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:36.844327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 653/1306] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:50:36.853531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:36.855542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:37.000265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9e7b-ea76-4e15-a081-3eace3593e4f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:37.100196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:37.100952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:37.101842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:37.101842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:37.102370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:37.104516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be8f75-ce85-4870-a621-57b31318ae96 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:37.127071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 654/1307] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:50:36 2021] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:50:39.539990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:39.540567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:39.540567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:39.542542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 654/1308] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:39.548699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40730c-8f5e-4fb7-8ac0-1cc96d44f8c7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:39.549140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40730c-8f5e-4fb7-8ac0-1cc96d44f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:39.549259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40730c-8f5e-4fb7-8ac0-1cc96d44f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:39.625703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fb40730c-8f5e-4fb7-8ac0-1cc96d44f8c7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:39.626866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fb40730c-8f5e-4fb7-8ac0-1cc96d44f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:39.731408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 655/1309] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:39.756158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:39.757690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:39.888255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f5be9-a6c2-4cfc-a6da-585e7c44861f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:39.989845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:39.990534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:39.990822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:39.991089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:39.991829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:39.993706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c948d-a4df-45e0-a5ed-ad79dd9caf16 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:40.013119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 655/1310] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:50:39 2021] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:50:42.419524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05d6a-4446-41da-be7b-fe29966a55f3 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:42.420121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05d6a-4446-41da-be7b-fe29966a55f3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:42.420121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d05d6a-4446-41da-be7b-fe29966a55f3 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:42.421810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 656/1311] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:42.427839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0777e-88fe-4a45-865e-09c224a5c584 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:42.428338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0777e-88fe-4a45-865e-09c224a5c584 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:42.428338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0777e-88fe-4a45-865e-09c224a5c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:42.492778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-afd0777e-88fe-4a45-865e-09c224a5c584 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:42.494193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-afd0777e-88fe-4a45-865e-09c224a5c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:42.595796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 656/1312] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:42.647066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:42.647330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:42.647632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:42.649484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 657/1313] 10.222.0.65 () {54 vars in 964 bytes} [Thu Dec 23 11:50:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:42.657927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107db3c-9f8c-4322-8c6c-2c17a01cc843 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:42.658213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107db3c-9f8c-4322-8c6c-2c17a01cc843 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:42.658484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107db3c-9f8c-4322-8c6c-2c17a01cc843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:42.734587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f107db3c-9f8c-4322-8c6c-2c17a01cc843 None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:42.735779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f107db3c-9f8c-4322-8c6c-2c17a01cc843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:42.809426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 657/1314] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Dec 23 11:50:42 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:42.819167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:42.820829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:42.935849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f79b-7342-4a17-a19d-730442fef549 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:43.011415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:43.012076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:43.012360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:43.012629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:43.014311 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:43.126642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:43.128025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32cb99-5d2f-4500-88b5-2357f2258f8c service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:43.146199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 658/1315] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:50:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:50:45.788212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:45.788851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:45.788851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:45.791836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 658/1316] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:45.797641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:45.798120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:45.798232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:45.867831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:45.869111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:45.973941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 659/1317] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:46.008537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:46.010176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:46.143480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3f7f0-a0bf-4f4e-a73a-804096029f50 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:46.240823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:46.241706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:46.241983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:46.242254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:46.243215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:46.245150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed08e6-7308-4749-b2f4-131b354710b8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:46.246866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 659/1318] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:50:46 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:50:46.259911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:46.261282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:46.371338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e31b4-8bca-4f81-a156-768e50d82105 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:46.451964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:46.452515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:46.452793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:46.453068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:46.454733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:46.564782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:46.566245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca66a-be6c-4dc7-92cf-232b713a2e8d service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:46.585870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 660/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:50:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:50:49.355630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:49.356233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:49.356233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:49.357968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 660/1320] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:49.365090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab2d-01f2-4d91-928c-cbc465df6ad8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:49.365642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab2d-01f2-4d91-928c-cbc465df6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:49.365781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eab2d-01f2-4d91-928c-cbc465df6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:49.440672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b30eab2d-01f2-4d91-928c-cbc465df6ad8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:49.441878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b30eab2d-01f2-4d91-928c-cbc465df6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:49.537887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 661/1321] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:49.573790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:49.576283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:49.715464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a5576-b0bc-4ce0-bb76-6f92d3739201 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:49.819742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:49.820616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:49.820894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:49.821168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:49.834227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:49.837529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6c347-1eb5-468f-bce7-a52216efc36c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:49.840406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 661/1322] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:50:49 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:50:49.874024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:49.874338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:49.874675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:49.877312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 662/1323] 10.222.0.65 () {54 vars in 964 bytes} [Thu Dec 23 11:50:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:49.886501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da9a5-50b7-428b-b8ca-ff60cc51d8ec None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:49.886809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da9a5-50b7-428b-b8ca-ff60cc51d8ec None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:49.887080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da9a5-50b7-428b-b8ca-ff60cc51d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:49.967031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-619da9a5-50b7-428b-b8ca-ff60cc51d8ec None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:49.968130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-619da9a5-50b7-428b-b8ca-ff60cc51d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:50.057052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 662/1324] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Dec 23 11:50:49 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:50.066671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:50.068228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:50.182115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023d5d3-a2e6-4aee-b399-73407945bb2e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:50.263295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:50.263782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:50.264155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:50.264627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:50.266539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:50.388869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:50.390313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4487a4-9fac-40bf-9a84-f45a31f8055a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:50.409786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 663/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:50:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:50:53.721092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:53.721602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:53.721602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:53.724497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 663/1326] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:53.732685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:53.733156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:53.733259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:53.801233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:53.802436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:53.910241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 664/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:50:53.952088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:53.953648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:54.090557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063aabd-f0c2-4760-9968-c82f7d24c77e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:54.195991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:54.197115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:54.197394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:54.197656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:54.211026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:54.213286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4e20-db76-4b7f-addb-6836526f6d24 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:54.215099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 664/1328] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:50:53 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:50:54.231685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:54.233666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:54.352102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dc6a8-5938-4391-b620-ff5399e4194d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:54.430244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:54.431044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:54.431744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:54.431744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:54.433199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:54.544774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:54.546203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced7dc-4ac2-49a1-be2b-1977a38e50fe service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:54.573522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 665/1329] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:50:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:50:57.821731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:57.822291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:57.822291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:57.824359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 665/1330] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:50:57.830329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124156e-a3a1-400c-9cf4-d0405d4c52e1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:57.830811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124156e-a3a1-400c-9cf4-d0405d4c52e1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:57.830975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124156e-a3a1-400c-9cf4-d0405d4c52e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:57.902312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d124156e-a3a1-400c-9cf4-d0405d4c52e1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:50:57.903565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d124156e-a3a1-400c-9cf4-d0405d4c52e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:58.012399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 666/1331] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:50:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:50:58.052411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:50:58.053975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:58.168582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98264d-af5a-4aaa-a186-7f8d0988896e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:50:58.244662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:50:58.245317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:50:58.245620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:50:58.245891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:50:58.247561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:50:58.364442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:50:58.365874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275323-da96-4b1e-9299-59f4d4796eef service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:50:58.388105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 666/1332] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:50:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:00.825083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:00.825694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:00.825694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:00.827460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 667/1333] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:00.833987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1758-4924-474c-8eb6-c7a97adab515 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:00.834461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1758-4924-474c-8eb6-c7a97adab515 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:00.834591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a1758-4924-474c-8eb6-c7a97adab515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:00.908785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7b1a1758-4924-474c-8eb6-c7a97adab515 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:00.909970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7b1a1758-4924-474c-8eb6-c7a97adab515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:01.009052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 667/1334] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:51:01.047648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:01.049218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:01.158872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186d5c-6df8-4a54-ba7e-942438666da7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:01.232640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:01.233294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:01.233572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:01.233838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:01.235548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:01.346295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:01.347811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc1e7-37a5-4fee-ade4-c8138cad05cf service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:01.367355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 668/1335] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:03.817193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:03.817755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:03.817755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:03.819533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 668/1336] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:03.825788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:03.826257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:03.826354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:03.891462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:03.892678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:03.993417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 669/1337] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:51:04.027472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:04.029066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:04.162832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c3e21-e10d-4f5a-9d21-e7fc57cfd5e8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:04.261280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:04.262153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:04.262433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:04.262766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] PATH_INFO: `/v3/projects/b56cb35e4f3348fcbb83cde892ed7817` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:04.273303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=b56cb35e4f3348fcbb83cde892ed7817)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:04.275713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e173bb-a893-4052-a3f5-8b1de940b2d3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:04.277771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 669/1338] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:51:04 2021] GET /identity/v3/projects/b56cb35e4f3348fcbb83cde892ed7817 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:51:04.290766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:04.292223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:04.400799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56afc96-b48a-437d-918b-c01fcc81e0e9 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:04.480891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:04.481490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:04.481768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:04.482041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:04.483793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:04.602404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:04.603966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c29528-6111-489d-bf53-c789a3f1daf4 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:04.624881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 670/1339] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:07.303337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:07.303924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:07.303924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:07.305782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 670/1340] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:07.312027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42a60-be67-4c8b-8b48-c096fb6d157c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:07.312558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42a60-be67-4c8b-8b48-c096fb6d157c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:07.312691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42a60-be67-4c8b-8b48-c096fb6d157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:07.392868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cbc42a60-be67-4c8b-8b48-c096fb6d157c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:07.394071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cbc42a60-be67-4c8b-8b48-c096fb6d157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:07.499458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 671/1341] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:07.538264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:07.541499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:07.648556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9e3e-988f-47c5-bf75-5524c240770f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:07.652581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:07.653252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:07.653530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:07.653807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:07.664467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:07.666297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef0d6-2dac-45ff-a325-3c81cc09aa5e service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:07.676668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 671/1342] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:10.289927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36145b1-d14b-4179-9648-88e50d39027e None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:10.290653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36145b1-d14b-4179-9648-88e50d39027e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:10.290653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36145b1-d14b-4179-9648-88e50d39027e None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:10.292612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 672/1343] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:10.299562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:10.300030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:10.300151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:10.325781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:10.327012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:10.336349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 672/1344] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:10.371588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36145b1-d14b-4179-9648-88e50d39027e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:10.384629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36145b1-d14b-4179-9648-88e50d39027e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:10.389132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:10.389982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:10.390257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:10.390555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:10.391834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:10.393682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a769e0-d21a-4f2f-90ee-440f80b94f9b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:10.395353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 673/1345] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:51:10 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:51:10.408396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:10.410832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:10.430368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb574ee-f492-458a-8865-01787b6c755b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:10.435697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:10.436344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:10.436620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:10.436889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:10.447352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:10.448765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a99233-e421-4e45-a820-30d08d85d1c9 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:10.458414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 673/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:13.268332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af229-12e1-4554-a34f-9f9bf7aa3e8f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:13.268890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af229-12e1-4554-a34f-9f9bf7aa3e8f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:13.268890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af229-12e1-4554-a34f-9f9bf7aa3e8f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:13.270669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 674/1347] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:13.277687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2e5d-14e1-4d86-b84a-a5fc3cb55bf9 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:13.278422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2e5d-14e1-4d86-b84a-a5fc3cb55bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:13.278531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2e5d-14e1-4d86-b84a-a5fc3cb55bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:13.304752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-09fe2e5d-14e1-4d86-b84a-a5fc3cb55bf9 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:13.306957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-09fe2e5d-14e1-4d86-b84a-a5fc3cb55bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:13.321746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 674/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:13.359032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af229-12e1-4554-a34f-9f9bf7aa3e8f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:13.372135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af229-12e1-4554-a34f-9f9bf7aa3e8f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:13.376960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:13.377623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:13.377934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:13.378172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:13.388351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:13.389799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb88f3-e562-4017-95e7-b330babd2a5d service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:13.399450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 675/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:17.824414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533c31-4fea-4e9f-b416-4e92819b2214 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:17.825043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533c31-4fea-4e9f-b416-4e92819b2214 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:17.825043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533c31-4fea-4e9f-b416-4e92819b2214 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:17.826800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 675/1350] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:17.832869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648df7c-005e-4951-93ba-a4d4ee6a46fc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:17.833315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648df7c-005e-4951-93ba-a4d4ee6a46fc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:17.833417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648df7c-005e-4951-93ba-a4d4ee6a46fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:17.854188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e648df7c-005e-4951-93ba-a4d4ee6a46fc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:17.855547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e648df7c-005e-4951-93ba-a4d4ee6a46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:17.865276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 676/1351] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:17.889488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533c31-4fea-4e9f-b416-4e92819b2214 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:17.903233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533c31-4fea-4e9f-b416-4e92819b2214 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:17.908609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:17.909263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:17.909540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:17.909952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:17.910738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:17.912579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96747-41b0-45ba-b5a7-1e9150b3025c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:17.926786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 676/1352] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:51:17 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:51:20.380099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9f84-45e8-4218-afed-6881036ea29f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:20.380584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9f84-45e8-4218-afed-6881036ea29f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:20.380584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9f84-45e8-4218-afed-6881036ea29f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:20.382431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 677/1353] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:20.388484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:20.389265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:20.389542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:20.408528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:20.409824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:20.418919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 677/1354] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:20.453889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9f84-45e8-4218-afed-6881036ea29f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:20.467820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9f84-45e8-4218-afed-6881036ea29f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:20.473123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:20.473971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:20.474240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:20.474503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:20.475803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:20.477712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970523-5900-4812-a797-d661aa9c5f30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:20.479548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 678/1355] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:51:20 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:51:20.492427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:20.502154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a9b27-6cb1-4ad6-ba22-a44d848932fd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:20.505835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:20.506533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:20.506803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:20.507068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:20.516426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:20.517853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec8088-efe3-463d-9768-e76949a3b464 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:20.527478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 678/1356] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:23.539075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7a7e-462a-4d7d-8bcd-557db41eb459 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:23.539996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7a7e-462a-4d7d-8bcd-557db41eb459 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:23.539996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e7a7e-462a-4d7d-8bcd-557db41eb459 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:23.541825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 679/1357] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:23.550034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564dfc-1911-406b-b78e-4728c6b9581f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:23.550459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564dfc-1911-406b-b78e-4728c6b9581f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:23.550578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564dfc-1911-406b-b78e-4728c6b9581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:23.570117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0f564dfc-1911-406b-b78e-4728c6b9581f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:23.571447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0f564dfc-1911-406b-b78e-4728c6b9581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:23.581133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 679/1358] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:23.619345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7a7e-462a-4d7d-8bcd-557db41eb459 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:23.630826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e7a7e-462a-4d7d-8bcd-557db41eb459 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:23.635207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:23.635842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:23.636126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:23.636395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:23.648588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:23.651133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66608-e0b8-4e57-8819-a7724f528782 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:23.665988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 680/1359] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:28.361392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620bf27-a5b7-4322-87cc-d7656d751e05 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:28.361842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620bf27-a5b7-4322-87cc-d7656d751e05 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:28.361950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620bf27-a5b7-4322-87cc-d7656d751e05 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:28.364212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 680/1360] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:28.370373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0688-2f49-4b87-b7d3-b2b776cb0ee2 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:28.370850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0688-2f49-4b87-b7d3-b2b776cb0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:28.370987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c0688-2f49-4b87-b7d3-b2b776cb0ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:28.390022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ab5c0688-2f49-4b87-b7d3-b2b776cb0ee2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:28.391332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ab5c0688-2f49-4b87-b7d3-b2b776cb0ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:28.400794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 681/1361] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:28.443736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620bf27-a5b7-4322-87cc-d7656d751e05 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:28.462987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620bf27-a5b7-4322-87cc-d7656d751e05 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:28.467991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:28.468629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:28.468904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:28.469173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:28.479584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:28.481013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3025c-cb66-43fe-8f38-d991ac619f75 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:28.490658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 681/1362] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:33.398484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787319-371f-4ec9-9396-61de1eb47fff None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:33.399724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787319-371f-4ec9-9396-61de1eb47fff None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:33.400363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787319-371f-4ec9-9396-61de1eb47fff None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:33.402722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 682/1363] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:51:33 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:33.407912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eca04-a5fe-4e97-8839-e7e1fcfb4a57 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:33.408333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eca04-a5fe-4e97-8839-e7e1fcfb4a57 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:33.408462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eca04-a5fe-4e97-8839-e7e1fcfb4a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:33.524885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-389eca04-a5fe-4e97-8839-e7e1fcfb4a57 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:33.526218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-389eca04-a5fe-4e97-8839-e7e1fcfb4a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:33.602969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 682/1364] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:51:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:37.890736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca6497-ca33-48d8-b65b-1c477724f5d6 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:37.891298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca6497-ca33-48d8-b65b-1c477724f5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:37.891298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca6497-ca33-48d8-b65b-1c477724f5d6 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:37.893430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 683/1365] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:51:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:37.898712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b669-e261-4e75-ba9e-3b12815a1d01 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:37.899286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b669-e261-4e75-ba9e-3b12815a1d01 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:37.899286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b669-e261-4e75-ba9e-3b12815a1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:37.919013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-51d3b669-e261-4e75-ba9e-3b12815a1d01 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:37.920520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-51d3b669-e261-4e75-ba9e-3b12815a1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:37.929749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 683/1366] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:51:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:39.496569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791824-aa27-4f05-82dd-92cd6b6974dc None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:39.497091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791824-aa27-4f05-82dd-92cd6b6974dc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:39.497091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791824-aa27-4f05-82dd-92cd6b6974dc None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:39.499276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 684/1367] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:51:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:39.504584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137305c-9c24-4c82-b6f1-aec4e6464634 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:39.505011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137305c-9c24-4c82-b6f1-aec4e6464634 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:39.505133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137305c-9c24-4c82-b6f1-aec4e6464634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:39.525695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a137305c-9c24-4c82-b6f1-aec4e6464634 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:39.526997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a137305c-9c24-4c82-b6f1-aec4e6464634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:39.536486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 684/1368] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:51:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:43.472087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35e687-5cfb-480e-ae07-65cbc8eced4f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:43.472703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35e687-5cfb-480e-ae07-65cbc8eced4f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:43.472703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35e687-5cfb-480e-ae07-65cbc8eced4f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:43.474705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 685/1369] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:43.480747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebb39-8711-426b-a450-68732ee12c00 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:43.481613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebb39-8711-426b-a450-68732ee12c00 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:43.481852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bebb39-8711-426b-a450-68732ee12c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:43.503206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-62bebb39-8711-426b-a450-68732ee12c00 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:43.504712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-62bebb39-8711-426b-a450-68732ee12c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:43.513931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 685/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:43.564578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eda18d-4629-4934-86ad-2a9584316e7c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:43.564903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eda18d-4629-4934-86ad-2a9584316e7c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:43.565126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eda18d-4629-4934-86ad-2a9584316e7c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:43.567072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 686/1371] 10.222.0.65 () {54 vars in 961 bytes} [Thu Dec 23 11:51:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:43.572850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60416-d0b6-4a29-8723-ad081557e839 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:43.573132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60416-d0b6-4a29-8723-ad081557e839 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:43.573405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60416-d0b6-4a29-8723-ad081557e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:43.624327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-fdc60416-d0b6-4a29-8723-ad081557e839 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:43.625739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fdc60416-d0b6-4a29-8723-ad081557e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:43.711718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 686/1372] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Dec 23 11:51:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:43.720557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eda18d-4629-4934-86ad-2a9584316e7c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:43.735888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eda18d-4629-4934-86ad-2a9584316e7c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:43.742178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:43.743120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:43.743568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:43.743943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:43.752657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:43.754399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14d0eb-02f1-4c36-89c9-e4b11c1035bd service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:43.766678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 687/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:51:46.360734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23bfa-e1a8-4933-bc9e-42157139319f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:46.361227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23bfa-e1a8-4933-bc9e-42157139319f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:46.361320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23bfa-e1a8-4933-bc9e-42157139319f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:46.364690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 687/1374] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:46.370132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6202-6423-4df9-b684-b9b321d6962a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:46.370665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6202-6423-4df9-b684-b9b321d6962a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:46.370665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6202-6423-4df9-b684-b9b321d6962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:46.390485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f47b6202-6423-4df9-b684-b9b321d6962a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:46.391688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f47b6202-6423-4df9-b684-b9b321d6962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:46.401958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 688/1375] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:51:46.448525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23bfa-e1a8-4933-bc9e-42157139319f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:46.464496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23bfa-e1a8-4933-bc9e-42157139319f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:46.470874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:46.471769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:46.472273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:46.472753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:46.481457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:46.483323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369cdf-8e7c-4acd-8d1b-b2cbbc72da26 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:46.493881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 688/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:49.172328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268273ed-6ee2-408c-88e3-4e7064fe9bd1 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:49.172870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268273ed-6ee2-408c-88e3-4e7064fe9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:49.172870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268273ed-6ee2-408c-88e3-4e7064fe9bd1 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:49.174615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 689/1377] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:49.180760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60d13-b4a2-46c4-a566-028934da3963 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:49.181538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60d13-b4a2-46c4-a566-028934da3963 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:49.181814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f60d13-b4a2-46c4-a566-028934da3963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:49.200679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-63f60d13-b4a2-46c4-a566-028934da3963 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:49.202223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-63f60d13-b4a2-46c4-a566-028934da3963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:49.210712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 689/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:49.259639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f207-2d77-4187-88fd-0c92fc2bf0d5 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:49.260294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f207-2d77-4187-88fd-0c92fc2bf0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:49.260572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f207-2d77-4187-88fd-0c92fc2bf0d5 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:49.262498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 690/1379] 10.222.0.65 () {54 vars in 961 bytes} [Thu Dec 23 11:51:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:49.271233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dd8e-beff-45b2-bd8b-7272121bee04 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:49.271558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dd8e-beff-45b2-bd8b-7272121bee04 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:49.272011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531dd8e-beff-45b2-bd8b-7272121bee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:49.294062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d531dd8e-beff-45b2-bd8b-7272121bee04 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:49.295322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d531dd8e-beff-45b2-bd8b-7272121bee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:49.305688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 690/1380] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Dec 23 11:51:49 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:49.315528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f207-2d77-4187-88fd-0c92fc2bf0d5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:49.331877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f207-2d77-4187-88fd-0c92fc2bf0d5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:49.338563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:49.339483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:49.339914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:49.340364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:49.364094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:49.365780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f480f-7429-40a2-a9a3-e7ea4b690247 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:49.376310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 691/1381] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:51.592110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e127-4f97-4308-9783-3d95e37425bb None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.592660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e127-4f97-4308-9783-3d95e37425bb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.592660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58e127-4f97-4308-9783-3d95e37425bb None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.594724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 691/1382] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:51.600555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90da0b-b16e-4249-8e53-83269d7b7ea2 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.600977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90da0b-b16e-4249-8e53-83269d7b7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.601076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90da0b-b16e-4249-8e53-83269d7b7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.619887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-bd90da0b-b16e-4249-8e53-83269d7b7ea2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:51.620997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-bd90da0b-b16e-4249-8e53-83269d7b7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:51.629509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 692/1383] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:51.685234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653b4ac-0ea0-47ae-a55f-c485c15aaca6 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.685805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653b4ac-0ea0-47ae-a55f-c485c15aaca6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.686060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653b4ac-0ea0-47ae-a55f-c485c15aaca6 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.688028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 692/1384] 10.222.0.65 () {54 vars in 963 bytes} [Thu Dec 23 11:51:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:51.693662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.693931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.694229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.746153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] MFA Rules not processed for user `16cff1dd38b24c53b75703647fddd213`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:51.747417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:51.793701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13011b-cfff-4b14-a75b-1436955402fa None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.793964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13011b-cfff-4b14-a75b-1436955402fa None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.794422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13011b-cfff-4b14-a75b-1436955402fa None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.796357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 693/1385] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:51.802185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.802717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.803354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.808663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 693/1386] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Dec 23 11:51:51 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:51.816778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:51.823752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:51.824551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ebf9-bf40-4a50-924c-526fbceb9dfa None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:51.824920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:51.828291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:51.828881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.829166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.829439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.834552 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 694/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:51.839134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:51.840589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f16067-1a27-462c-b48a-ca60aed1f8b2 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:51.850308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 694/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:51:51.889927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:51.908930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819633-91d1-45ed-ba9f-9ee4a1691f1a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:51.914939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:51.915668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:51.915954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:51.916225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:51.925351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:51.927012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957a19c-8e0c-4fa5-925f-507b5a27cac8 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:51.937390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 695/1389] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:54.333172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145106-d160-447b-9a7e-4dbecdd87a56 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:54.333736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145106-d160-447b-9a7e-4dbecdd87a56 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:54.333736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145106-d160-447b-9a7e-4dbecdd87a56 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:54.335856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 695/1390] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:54.341639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0cfc-5733-42de-8c9b-22931e2d149d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:54.342170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0cfc-5733-42de-8c9b-22931e2d149d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:54.342170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee0cfc-5733-42de-8c9b-22931e2d149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:54.364462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8bee0cfc-5733-42de-8c9b-22931e2d149d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:54.365649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8bee0cfc-5733-42de-8c9b-22931e2d149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:54.376632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 696/1391] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:54.427773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4145106-d160-447b-9a7e-4dbecdd87a56 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:54.443785 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4145106-d160-447b-9a7e-4dbecdd87a56 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:54.450019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:54.450708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:54.450993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:54.451269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:54.459721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:54.461813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6751a2-7512-47c5-9f2a-6e8bb89f4dfe service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:54.471227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 696/1392] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:57.035263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce250-9537-42c5-ac44-2e5fbda6b775 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:57.036581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce250-9537-42c5-ac44-2e5fbda6b775 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:57.037006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce250-9537-42c5-ac44-2e5fbda6b775 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:57.039724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 697/1393] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:57.047922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839298-ed72-411f-a794-bd924daefacd None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:57.048557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839298-ed72-411f-a794-bd924daefacd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:57.048557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839298-ed72-411f-a794-bd924daefacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:57.069293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-29839298-ed72-411f-a794-bd924daefacd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:57.070949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-29839298-ed72-411f-a794-bd924daefacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:57.080173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 697/1394] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:51:57.128299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ce250-9537-42c5-ac44-2e5fbda6b775 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:57.144298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ce250-9537-42c5-ac44-2e5fbda6b775 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:57.150922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:57.151843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:57.152216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:57.152584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:57.162080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:57.163841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964494ee-2205-4ec3-8327-2b3ecc72e82f service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:57.174359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 698/1395] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:51:59.747686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba0a4-b419-4bdf-8089-31e11cdf9ef2 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:59.748296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba0a4-b419-4bdf-8089-31e11cdf9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:59.748647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ba0a4-b419-4bdf-8089-31e11cdf9ef2 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:59.750808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 698/1396] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:51:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:51:59.758389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33d47-86c6-4cb0-aa69-9cb46a112655 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:59.758971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33d47-86c6-4cb0-aa69-9cb46a112655 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:59.759186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b33d47-86c6-4cb0-aa69-9cb46a112655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:59.780704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-78b33d47-86c6-4cb0-aa69-9cb46a112655 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:51:59.782203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-78b33d47-86c6-4cb0-aa69-9cb46a112655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:51:59.793045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 699/1397] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:51:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:51:59.848476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba0a4-b419-4bdf-8089-31e11cdf9ef2 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:51:59.866493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ba0a4-b419-4bdf-8089-31e11cdf9ef2 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:51:59.873176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:51:59.873821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:51:59.874094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:51:59.874360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:51:59.883806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:51:59.885528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad9f47-77e0-4af8-926d-6a53e1a25998 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:51:59.895791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 699/1398] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:51:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:02.446467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46541f-df93-4610-a26f-b8e28ab7501f None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:02.447082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46541f-df93-4610-a26f-b8e28ab7501f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:02.447536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46541f-df93-4610-a26f-b8e28ab7501f None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:02.450622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 700/1399] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:02.457008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a6b57-a53e-4439-b3fd-26b5c7e31fbd None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:02.457615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a6b57-a53e-4439-b3fd-26b5c7e31fbd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:02.457615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a6b57-a53e-4439-b3fd-26b5c7e31fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:02.480078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7e9a6b57-a53e-4439-b3fd-26b5c7e31fbd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:02.481315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e9a6b57-a53e-4439-b3fd-26b5c7e31fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:02.490487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 700/1400] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:02.547052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46541f-df93-4610-a26f-b8e28ab7501f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:02.563607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46541f-df93-4610-a26f-b8e28ab7501f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:02.570197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:02.571525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:02.571807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:02.572050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:02.581623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:02.583374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55fdf0-034d-4a7c-8318-ba2bf9aceb3b service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:02.593540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 701/1401] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:05.171026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a47a2-2d83-4b91-8125-ffcb761aa31e None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:05.171959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a47a2-2d83-4b91-8125-ffcb761aa31e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:05.171959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a47a2-2d83-4b91-8125-ffcb761aa31e None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:05.174245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 701/1402] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:05.181630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e7f8-2ac9-4930-bb93-c998d1c108ae None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:05.182094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e7f8-2ac9-4930-bb93-c998d1c108ae None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:05.182302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e7f8-2ac9-4930-bb93-c998d1c108ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:05.205390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8ad0e7f8-2ac9-4930-bb93-c998d1c108ae None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:05.207067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8ad0e7f8-2ac9-4930-bb93-c998d1c108ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:05.219036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 702/1403] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:05.269267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a47a2-2d83-4b91-8125-ffcb761aa31e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:05.285722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a47a2-2d83-4b91-8125-ffcb761aa31e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:05.291926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:05.292634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:05.292907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:05.293201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:05.302872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:05.304727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a5bb1-c59d-4ef8-b9a6-f99569791bff service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:05.315182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 702/1404] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:07.753716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5a1a-4678-4d85-8b0c-85b9f5cbdb59 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:07.754269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5a1a-4678-4d85-8b0c-85b9f5cbdb59 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:07.754269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c5a1a-4678-4d85-8b0c-85b9f5cbdb59 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:07.756021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 703/1405] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:07.762242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff818-4b3d-4815-bdad-e4aea6b14eaa None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:07.762735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff818-4b3d-4815-bdad-e4aea6b14eaa None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:07.762845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff818-4b3d-4815-bdad-e4aea6b14eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:07.781142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-007ff818-4b3d-4815-bdad-e4aea6b14eaa None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:07.782320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-007ff818-4b3d-4815-bdad-e4aea6b14eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:07.791084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 703/1406] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:07.836821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c5a1a-4678-4d85-8b0c-85b9f5cbdb59 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:07.852656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c5a1a-4678-4d85-8b0c-85b9f5cbdb59 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:07.859499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:07.860155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:07.860432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:07.860689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:07.870441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:07.872229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c56b2-815a-4b75-9958-55fe59eecf3e service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:07.883907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 704/1407] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:08.518288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747142c-3e48-4d68-966f-73d99a4f3efb None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:08.518604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747142c-3e48-4d68-966f-73d99a4f3efb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:08.518884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747142c-3e48-4d68-966f-73d99a4f3efb None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:08.520730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 704/1408] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:52:08.526928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a860e-b9f1-47a5-b698-518e57c3a900 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:08.527229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a860e-b9f1-47a5-b698-518e57c3a900 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:08.527529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a860e-b9f1-47a5-b698-518e57c3a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:08.547582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-664a860e-b9f1-47a5-b698-518e57c3a900 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:08.548830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-664a860e-b9f1-47a5-b698-518e57c3a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:08.558053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 705/1409] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:08.616052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a671-684c-4bec-a111-755384a62d40 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:08.616370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a671-684c-4bec-a111-755384a62d40 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:08.616754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a671-684c-4bec-a111-755384a62d40 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:08.618641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 705/1410] 10.222.0.65 () {54 vars in 962 bytes} [Thu Dec 23 11:52:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:08.624423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7987c6-3311-4c00-97cc-a835393130a6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:08.624712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7987c6-3311-4c00-97cc-a835393130a6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:08.624986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7987c6-3311-4c00-97cc-a835393130a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:08.678930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-dd7987c6-3311-4c00-97cc-a835393130a6 None None] MFA Rules not processed for user `049a0120570d4d6e94d4d10a7460226d`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:08.680414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-dd7987c6-3311-4c00-97cc-a835393130a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:08.748586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 706/1411] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Dec 23 11:52:08 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:08.756474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3a671-684c-4bec-a111-755384a62d40 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:08.768324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3a671-684c-4bec-a111-755384a62d40 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:08.772319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:08.772979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:08.773254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:08.773574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:08.783292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:08.784798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea125d-6cb5-47cb-8ac1-497d5fab11ac service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:08.794799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 706/1412] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:09.260614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ddaef-a8bd-4eaa-8af9-fba6ffa2e084 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:09.261169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ddaef-a8bd-4eaa-8af9-fba6ffa2e084 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:09.261451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ddaef-a8bd-4eaa-8af9-fba6ffa2e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:09.317255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1e2ddaef-a8bd-4eaa-8af9-fba6ffa2e084 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:09.318599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1e2ddaef-a8bd-4eaa-8af9-fba6ffa2e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:09.393413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 707/1413] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:52:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:09.441272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c5b1-8f0e-459f-a3c8-b6301d12e968 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:09.441558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c5b1-8f0e-459f-a3c8-b6301d12e968 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:09.441835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439c5b1-8f0e-459f-a3c8-b6301d12e968 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:09.443729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 707/1414] 10.222.0.65 () {54 vars in 942 bytes} [Thu Dec 23 11:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:09.451478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf419-4fba-4ecf-8e42-4def65a662f0 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:09.451766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf419-4fba-4ecf-8e42-4def65a662f0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:09.452028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facf419-4fba-4ecf-8e42-4def65a662f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:09.503200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2facf419-4fba-4ecf-8e42-4def65a662f0 None None] MFA Rules not processed for user `b2b3428dc311404ba2f0dffa002d5ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:09.504428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2facf419-4fba-4ecf-8e42-4def65a662f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:09.575456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 708/1415] 10.222.0.65 () {58 vars in 1039 bytes} [Thu Dec 23 11:52:09 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:09.585220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439c5b1-8f0e-459f-a3c8-b6301d12e968 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:09.599256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439c5b1-8f0e-459f-a3c8-b6301d12e968 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:09.604713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:09.605374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:09.605655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:09.605934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:09.614245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:09.615873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd1d55-a495-4de1-b0c6-9969f09262c9 service swift] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:09.624179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 708/1416] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 11:52:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:52:10.373185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2705a-149c-4d65-8968-e71f47b59b15 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:10.373733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2705a-149c-4d65-8968-e71f47b59b15 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:10.373733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2705a-149c-4d65-8968-e71f47b59b15 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:10.375790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 709/1417] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:10.381419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61845-80fe-46fb-b787-9b770e7747e6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:10.382250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61845-80fe-46fb-b787-9b770e7747e6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:10.382550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61845-80fe-46fb-b787-9b770e7747e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:10.402869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ddc61845-80fe-46fb-b787-9b770e7747e6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:10.404090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ddc61845-80fe-46fb-b787-9b770e7747e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:10.413762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 709/1418] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:10.461662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2705a-149c-4d65-8968-e71f47b59b15 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:10.480395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2705a-149c-4d65-8968-e71f47b59b15 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:10.486232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:10.486952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:10.487235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:10.487513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:10.497334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:10.498975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3beaf-aaca-4df5-824f-d52fd864f745 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:10.510057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 710/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:13.093917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcff3ab-0c68-4dc6-bf6a-bcb05bdd2638 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:13.094918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcff3ab-0c68-4dc6-bf6a-bcb05bdd2638 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:13.095202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcff3ab-0c68-4dc6-bf6a-bcb05bdd2638 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:13.097037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 710/1420] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:52:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:13.103561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51ecc-d687-45d5-9ef4-c3f2639990e8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:13.104001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51ecc-d687-45d5-9ef4-c3f2639990e8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:13.104221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51ecc-d687-45d5-9ef4-c3f2639990e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:13.127129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d1e51ecc-d687-45d5-9ef4-c3f2639990e8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:13.128348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d1e51ecc-d687-45d5-9ef4-c3f2639990e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:13.136371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 711/1421] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:52:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:13.184457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcff3ab-0c68-4dc6-bf6a-bcb05bdd2638 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:13.200161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcff3ab-0c68-4dc6-bf6a-bcb05bdd2638 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:13.206283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:13.207042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:13.207450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:13.207868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:13.217308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:13.219345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6aa79-cdcb-48ee-b71f-f81fda544c5a service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:13.238562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 711/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:32.298168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0b30-0038-4b2e-a2b3-051fb4080734 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:32.298848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0b30-0038-4b2e-a2b3-051fb4080734 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:32.298848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0b30-0038-4b2e-a2b3-051fb4080734 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:32.300529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 712/1423] 10.222.0.65 () {54 vars in 918 bytes} [Thu Dec 23 11:52:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:32.307133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136228-cf32-4990-b5b7-32d7781470cc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:32.307601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136228-cf32-4990-b5b7-32d7781470cc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:32.307787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136228-cf32-4990-b5b7-32d7781470cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:32.326435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-71136228-cf32-4990-b5b7-32d7781470cc None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:32.327687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-71136228-cf32-4990-b5b7-32d7781470cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:32.337543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 712/1424] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Dec 23 11:52:32 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:32.353306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c1281-054a-4de1-a8c8-f2e321812c30 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:32.353622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c1281-054a-4de1-a8c8-f2e321812c30 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:32.353861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c1281-054a-4de1-a8c8-f2e321812c30 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:32.355748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 713/1425] 10.222.0.65 () {54 vars in 918 bytes} [Thu Dec 23 11:52:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:32.361343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2da4b5-82fb-447e-9290-5381d7f81c7b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:32.361619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2da4b5-82fb-447e-9290-5381d7f81c7b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:32.361897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2da4b5-82fb-447e-9290-5381d7f81c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:32.383114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3a2da4b5-82fb-447e-9290-5381d7f81c7b None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:32.384606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3a2da4b5-82fb-447e-9290-5381d7f81c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:32.395638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 713/1426] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Dec 23 11:52:32 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:35.136406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740afea-f040-4a0a-9b6d-5f728735f94c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:35.137002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740afea-f040-4a0a-9b6d-5f728735f94c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:35.137002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740afea-f040-4a0a-9b6d-5f728735f94c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:35.138724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:52:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:52:35.144918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89b7e-4097-4946-8f58-b2c2fb909a1e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:35.145395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89b7e-4097-4946-8f58-b2c2fb909a1e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:35.145529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac89b7e-4097-4946-8f58-b2c2fb909a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:35.165278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cac89b7e-4097-4946-8f58-b2c2fb909a1e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:35.166480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cac89b7e-4097-4946-8f58-b2c2fb909a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:35.175715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:52:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:35.219867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740afea-f040-4a0a-9b6d-5f728735f94c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:35.242203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740afea-f040-4a0a-9b6d-5f728735f94c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:35.249166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:35.249835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:35.250118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:35.250386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:35.259708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:35.261319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f01da2-cfdb-4d3f-9b69-a9bbaed13fc1 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:35.270862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 715/1429] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:36.837847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aa159-1f51-470d-9db4-bbc6b499beaf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:36.838405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aa159-1f51-470d-9db4-bbc6b499beaf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:36.838405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aa159-1f51-470d-9db4-bbc6b499beaf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:36.841226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:36.846958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e18d-07ed-48ad-aa02-fdde04ae38a6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:36.847410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e18d-07ed-48ad-aa02-fdde04ae38a6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:36.847514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433e18d-07ed-48ad-aa02-fdde04ae38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:36.867865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d433e18d-07ed-48ad-aa02-fdde04ae38a6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:36.869037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d433e18d-07ed-48ad-aa02-fdde04ae38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:36.877042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:37.030169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aa159-1f51-470d-9db4-bbc6b499beaf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:37.046280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aa159-1f51-470d-9db4-bbc6b499beaf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:37.054564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:37.055382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:37.055662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:37.055930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:37.066548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:37.068218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177fa96-ae80-4dc6-97ec-6f5aec67b5e7 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:37.077619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 716/1432] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:38.591547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285ee-ef27-4cca-bf29-42de150b97cc None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:38.592154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285ee-ef27-4cca-bf29-42de150b97cc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:38.592154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285ee-ef27-4cca-bf29-42de150b97cc None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:38.593880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:38.602643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c55e-4e82-4738-80bf-c9898871b3aa None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:38.603088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c55e-4e82-4738-80bf-c9898871b3aa None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:38.603198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c55e-4e82-4738-80bf-c9898871b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:38.622082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0d13c55e-4e82-4738-80bf-c9898871b3aa None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:38.623187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0d13c55e-4e82-4738-80bf-c9898871b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:38.632780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:38.795358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46285ee-ef27-4cca-bf29-42de150b97cc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:38.812574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46285ee-ef27-4cca-bf29-42de150b97cc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:38.822780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:38.823427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:38.823707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:38.823981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:38.832785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:38.834366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da3f5c-b8e5-4b42-8945-a862f27a47ac service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:38.844855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 718/1435] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:40.375155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03b5d-f7ce-4424-8b08-d6f394f60409 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:40.375942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03b5d-f7ce-4424-8b08-d6f394f60409 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:40.375942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d03b5d-f7ce-4424-8b08-d6f394f60409 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:40.378856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:40.384934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69463d-a53a-4a49-b07f-e9f2813c64ec None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:40.385376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69463d-a53a-4a49-b07f-e9f2813c64ec None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:40.385504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69463d-a53a-4a49-b07f-e9f2813c64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:40.404936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0c69463d-a53a-4a49-b07f-e9f2813c64ec None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:40.406114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0c69463d-a53a-4a49-b07f-e9f2813c64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:40.415109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:40.567822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03b5d-f7ce-4424-8b08-d6f394f60409 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:40.591298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d03b5d-f7ce-4424-8b08-d6f394f60409 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:40.598226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:40.598893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:40.599176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:40.599449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:40.608390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:40.609908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3da3-f160-4afa-8640-ce2bfda7767b service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:40.620195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 719/1438] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:42.138458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c84-cbe6-4c9d-b44a-a240e0620c84 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:42.139381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c84-cbe6-4c9d-b44a-a240e0620c84 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:42.139381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c84-cbe6-4c9d-b44a-a240e0620c84 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:42.142228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:42.149227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5fda-2f6c-4b5e-be6e-8ef8920b7f98 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:42.149999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5fda-2f6c-4b5e-be6e-8ef8920b7f98 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:42.150122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a5fda-2f6c-4b5e-be6e-8ef8920b7f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:42.173826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-645a5fda-2f6c-4b5e-be6e-8ef8920b7f98 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:42.175039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-645a5fda-2f6c-4b5e-be6e-8ef8920b7f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:42.184626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:42.335062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2c84-cbe6-4c9d-b44a-a240e0620c84 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:42.353800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2c84-cbe6-4c9d-b44a-a240e0620c84 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:42.360610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:42.361253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:42.361530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:42.361795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:42.372107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:42.374352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec05e3-9cdf-499b-8ab4-45d3270a6750 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:42.386892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 721/1441] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:43.852773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca1c3-29a9-47b6-a355-2d32c8d989d7 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:43.853658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca1c3-29a9-47b6-a355-2d32c8d989d7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:43.853658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca1c3-29a9-47b6-a355-2d32c8d989d7 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:43.857282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:43.866632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8467a8-d67f-41cd-bcb8-a02cda53aded None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:43.867371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8467a8-d67f-41cd-bcb8-a02cda53aded None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:43.867665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8467a8-d67f-41cd-bcb8-a02cda53aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:43.891376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-df8467a8-d67f-41cd-bcb8-a02cda53aded None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:43.892562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-df8467a8-d67f-41cd-bcb8-a02cda53aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:43.901451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:44.058901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca1c3-29a9-47b6-a355-2d32c8d989d7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:44.079689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca1c3-29a9-47b6-a355-2d32c8d989d7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:44.086996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:44.087623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:44.087904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:44.088175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:44.097516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:44.099128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e151dd9-14c1-4401-84b1-402ac84a6ec8 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:44.109212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 722/1444] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:45.575976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286234-5a1c-4251-84f1-f7f60dcdab69 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:45.576820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286234-5a1c-4251-84f1-f7f60dcdab69 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:45.576820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286234-5a1c-4251-84f1-f7f60dcdab69 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:45.579792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:45.587395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05087-68b5-4b25-bccb-7777904ccd1e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:45.587864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05087-68b5-4b25-bccb-7777904ccd1e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:45.587973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05087-68b5-4b25-bccb-7777904ccd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:45.617582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-71f05087-68b5-4b25-bccb-7777904ccd1e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:45.618775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-71f05087-68b5-4b25-bccb-7777904ccd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:45.627674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:45.785033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286234-5a1c-4251-84f1-f7f60dcdab69 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:45.808680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286234-5a1c-4251-84f1-f7f60dcdab69 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:45.815260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:45.815896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:45.816178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:45.816447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:45.824853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:45.826457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc18fe-853d-42d1-9314-58483bd1927c service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:45.835947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 724/1447] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:47.289495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf40a5-aec0-43ff-a110-8597b54514d3 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:47.290076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf40a5-aec0-43ff-a110-8597b54514d3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:47.290076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf40a5-aec0-43ff-a110-8597b54514d3 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:47.292844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:47.301088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9556-ddcf-47c5-86d4-2baa1401387e None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:47.301560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9556-ddcf-47c5-86d4-2baa1401387e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:47.301669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af9556-ddcf-47c5-86d4-2baa1401387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:47.320620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-85af9556-ddcf-47c5-86d4-2baa1401387e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:47.321797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-85af9556-ddcf-47c5-86d4-2baa1401387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:47.330367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:47.483866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf40a5-aec0-43ff-a110-8597b54514d3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:47.500306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf40a5-aec0-43ff-a110-8597b54514d3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:47.507241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:47.507873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:47.508152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:47.508422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:47.516498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:47.518061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e139cb-6e19-4c12-bc94-05b26e3405a7 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:47.527318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 725/1450] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:49.005292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f851d-755f-4553-88e0-c79caa4c8ca9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:49.006096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f851d-755f-4553-88e0-c79caa4c8ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:49.006096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f851d-755f-4553-88e0-c79caa4c8ca9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:49.008901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:52:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:49.014791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d3bf-4779-4ddf-adbd-652bdaba8197 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:49.015240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d3bf-4779-4ddf-adbd-652bdaba8197 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:49.015434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d3bf-4779-4ddf-adbd-652bdaba8197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:49.035436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5e06d3bf-4779-4ddf-adbd-652bdaba8197 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:49.036632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5e06d3bf-4779-4ddf-adbd-652bdaba8197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:49.046263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:52:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:49.199490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f851d-755f-4553-88e0-c79caa4c8ca9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:49.223344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f851d-755f-4553-88e0-c79caa4c8ca9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:49.231314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:49.231958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:49.232238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:49.232511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:49.241019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:49.242969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822623b6-b13b-452d-8a57-c295f2b03608 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:49.252476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 727/1453] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:51.451726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd90e4-4816-40d2-bb88-5ed42293c416 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:51.452597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd90e4-4816-40d2-bb88-5ed42293c416 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:51.452597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd90e4-4816-40d2-bb88-5ed42293c416 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:51.455667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:52:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:51.461921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7190-c6cb-4ed1-b223-0fcc6a8895ec None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:51.462373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7190-c6cb-4ed1-b223-0fcc6a8895ec None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:51.462487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7190-c6cb-4ed1-b223-0fcc6a8895ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:51.484714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-048b7190-c6cb-4ed1-b223-0fcc6a8895ec None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:51.485897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-048b7190-c6cb-4ed1-b223-0fcc6a8895ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:51.495550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:52:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:51.537889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd90e4-4816-40d2-bb88-5ed42293c416 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:51.550707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd90e4-4816-40d2-bb88-5ed42293c416 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:51.555883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:51.556809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:51.557176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:51.557499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:51.568686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:51.570255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ff3f0-2532-41e2-8eb8-6482a9e90ba4 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:51.580083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 728/1456] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:54.073904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ec92-5be6-4813-8749-13a4ca3b2025 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:54.074537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ec92-5be6-4813-8749-13a4ca3b2025 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:54.074537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6ec92-5be6-4813-8749-13a4ca3b2025 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:54.076290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:52:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:54.082370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec76b-d30d-4b2b-8cbf-5d7d4552958f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:54.082858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec76b-d30d-4b2b-8cbf-5d7d4552958f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:54.082956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ec76b-d30d-4b2b-8cbf-5d7d4552958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:54.101439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7e5ec76b-d30d-4b2b-8cbf-5d7d4552958f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:54.102708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e5ec76b-d30d-4b2b-8cbf-5d7d4552958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:54.112455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:54.152273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6ec92-5be6-4813-8749-13a4ca3b2025 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:54.170241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6ec92-5be6-4813-8749-13a4ca3b2025 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:54.175580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:54.176217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:54.176494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:54.176766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:54.186159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:54.187627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e51f4-b5ff-48d1-bb72-5323d4ec86ad service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:54.197139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 730/1459] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:52:56.852270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8479b0-add5-4edf-881e-30e8c55ca360 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:56.852889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8479b0-add5-4edf-881e-30e8c55ca360 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:56.852889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8479b0-add5-4edf-881e-30e8c55ca360 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:56.854585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:52:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:56.867180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bd7a-3d9b-41ce-869c-12d29aa0097d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:56.867633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bd7a-3d9b-41ce-869c-12d29aa0097d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:56.867742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49bd7a-3d9b-41ce-869c-12d29aa0097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:56.886393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6f49bd7a-3d9b-41ce-869c-12d29aa0097d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:56.887590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6f49bd7a-3d9b-41ce-869c-12d29aa0097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:56.896369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:52:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:56.937875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8479b0-add5-4edf-881e-30e8c55ca360 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:56.956697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8479b0-add5-4edf-881e-30e8c55ca360 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:56.962189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:56.962993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:56.963141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:56.963375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:56.973275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:56.974754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce044f-b2b7-467e-81fa-e65df112fb72 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:56.984736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 731/1462] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:52:59.589127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d626-b994-4fd8-aa81-62d52b617014 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:59.590036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d626-b994-4fd8-aa81-62d52b617014 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:59.590036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1d626-b994-4fd8-aa81-62d52b617014 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:59.593012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:52:59 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:52:59.600161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37604-0a2b-49d5-ad33-ca5542647dd5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:59.601030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37604-0a2b-49d5-ad33-ca5542647dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:59.601128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb37604-0a2b-49d5-ad33-ca5542647dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:59.620592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6cb37604-0a2b-49d5-ad33-ca5542647dd5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:52:59.621716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6cb37604-0a2b-49d5-ad33-ca5542647dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:52:59.630900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:52:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:52:59.673728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d626-b994-4fd8-aa81-62d52b617014 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:52:59.692154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1d626-b994-4fd8-aa81-62d52b617014 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:52:59.697351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:52:59.697988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:52:59.698269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:52:59.698562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:52:59.708425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:52:59.709865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997301-d09a-4705-8a88-6b2c8865d366 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:52:59.719882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 733/1465] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:52:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:02.109792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e2b-c360-4aa0-af1e-98c05818f922 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:02.110371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e2b-c360-4aa0-af1e-98c05818f922 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:02.110371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6e2b-c360-4aa0-af1e-98c05818f922 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:02.112205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:02.119608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c27d9-7430-4ea8-be30-880ec3d07e38 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:02.120861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c27d9-7430-4ea8-be30-880ec3d07e38 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:02.121208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c27d9-7430-4ea8-be30-880ec3d07e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:02.149015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d37c27d9-7430-4ea8-be30-880ec3d07e38 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:02.150226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d37c27d9-7430-4ea8-be30-880ec3d07e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:02.159310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:02.198649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6e2b-c360-4aa0-af1e-98c05818f922 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:02.211767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd6e2b-c360-4aa0-af1e-98c05818f922 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:02.215606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:02.216236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:02.216511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:02.216780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:02.229035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:02.230557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5338e6-6df8-4d5e-ad5a-50cfcd002f56 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:02.240860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 734/1468] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:04.704299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b611224-6d25-4529-baf3-5b90fb8a6199 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:04.704934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b611224-6d25-4529-baf3-5b90fb8a6199 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:04.704934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b611224-6d25-4529-baf3-5b90fb8a6199 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:04.706887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:04.714544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fdaa-a3ec-4605-8180-58091142ae1d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:04.715010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fdaa-a3ec-4605-8180-58091142ae1d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:04.715104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5fdaa-a3ec-4605-8180-58091142ae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:04.737697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-aca5fdaa-a3ec-4605-8180-58091142ae1d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:04.739901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-aca5fdaa-a3ec-4605-8180-58091142ae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:04.753536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:04.792744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b611224-6d25-4529-baf3-5b90fb8a6199 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:04.806869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b611224-6d25-4529-baf3-5b90fb8a6199 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:04.813851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:04.814862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:04.815237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:04.815604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:04.827035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:04.828479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a24a06-13cf-48b6-95ae-ddfb922491e1 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:04.838610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 736/1471] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:07.248140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d078-3683-433e-a8de-0e211445c718 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:07.249039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d078-3683-433e-a8de-0e211445c718 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:07.249194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d078-3683-433e-a8de-0e211445c718 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:07.252842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:07 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:07.261184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a1ed-b0ee-4d6b-a188-5421c5bd2cd5 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:07.261655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a1ed-b0ee-4d6b-a188-5421c5bd2cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:07.261752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29a1ed-b0ee-4d6b-a188-5421c5bd2cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:07.280082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9f29a1ed-b0ee-4d6b-a188-5421c5bd2cd5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:07.281375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9f29a1ed-b0ee-4d6b-a188-5421c5bd2cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:07.289678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:53:07.328971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3d078-3683-433e-a8de-0e211445c718 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:07.346746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3d078-3683-433e-a8de-0e211445c718 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:07.352152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:07.352901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:07.353201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:07.353505 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:07.366060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:07.367666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ef32-a6bd-435b-94a8-cf11512c905a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:07.377951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 737/1474] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:09.800976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6eba-5566-46aa-901a-f8fa2cdd8132 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:09.801837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6eba-5566-46aa-901a-f8fa2cdd8132 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:09.801962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6eba-5566-46aa-901a-f8fa2cdd8132 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:09.804450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:09.813131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf5a2-f3e1-4227-9a29-a6f5dc8f7976 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:09.813583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf5a2-f3e1-4227-9a29-a6f5dc8f7976 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:09.813688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bf5a2-f3e1-4227-9a29-a6f5dc8f7976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:09.832332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-341bf5a2-f3e1-4227-9a29-a6f5dc8f7976 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:09.833533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-341bf5a2-f3e1-4227-9a29-a6f5dc8f7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:09.842899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:09.881872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6eba-5566-46aa-901a-f8fa2cdd8132 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:09.894700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6eba-5566-46aa-901a-f8fa2cdd8132 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:09.899341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:09.900010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:09.900283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:09.900551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:09.910354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:09.911835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7974d46-4613-417e-af77-048442ab5349 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:09.924161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 739/1477] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:12.321673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db858a-c9a5-4ba1-b969-7056e3295e1c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:12.322579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db858a-c9a5-4ba1-b969-7056e3295e1c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:12.322579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db858a-c9a5-4ba1-b969-7056e3295e1c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:12.325474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 739/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:12.332548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91470-b10e-4aed-8640-7399937090a2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:12.333426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91470-b10e-4aed-8640-7399937090a2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:12.333426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f91470-b10e-4aed-8640-7399937090a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:12.359350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f5f91470-b10e-4aed-8640-7399937090a2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:12.359957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f5f91470-b10e-4aed-8640-7399937090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:12.369405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 740/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:12.406966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db858a-c9a5-4ba1-b969-7056e3295e1c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:12.419478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db858a-c9a5-4ba1-b969-7056e3295e1c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:12.423541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:12.424173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:12.424420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:12.424689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:12.433842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:12.435308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2e995-a4c8-44ed-ac90-420bebcdd3d4 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:12.444581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 740/1480] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:14.828628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847edc-8869-428b-8d2b-a75f40df8907 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:14.829330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847edc-8869-428b-8d2b-a75f40df8907 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:14.829330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847edc-8869-428b-8d2b-a75f40df8907 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:14.831033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 741/1481] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:53:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:14.837430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaf33-5e27-4968-99bd-0c3af8631c5a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:14.837903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaf33-5e27-4968-99bd-0c3af8631c5a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:14.838010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaf33-5e27-4968-99bd-0c3af8631c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:14.856274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a0baaf33-5e27-4968-99bd-0c3af8631c5a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:14.857490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a0baaf33-5e27-4968-99bd-0c3af8631c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:14.866588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 741/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:53:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:14.904170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94847edc-8869-428b-8d2b-a75f40df8907 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:14.915320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94847edc-8869-428b-8d2b-a75f40df8907 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:14.919156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:14.919794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:14.920074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:14.920343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:14.929861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:14.931334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899109f-5b8e-455d-bbd7-5411c7f2b87d service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:14.940451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 742/1483] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:31.960649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63737c48-a5e1-416f-b49c-1ed818b71bb3 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:31.961248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63737c48-a5e1-416f-b49c-1ed818b71bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:31.961248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63737c48-a5e1-416f-b49c-1ed818b71bb3 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:31.963023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 742/1484] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:31.969985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171ebe-dbc8-4a02-9332-be41189f7751 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:31.970463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171ebe-dbc8-4a02-9332-be41189f7751 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:31.970600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171ebe-dbc8-4a02-9332-be41189f7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:31.992327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1c171ebe-dbc8-4a02-9332-be41189f7751 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:31.993532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1c171ebe-dbc8-4a02-9332-be41189f7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:32.003078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 743/1485] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:32.068930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f4ac3-1944-4c73-9d10-7cd4ad1c9659 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:32.069223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f4ac3-1944-4c73-9d10-7cd4ad1c9659 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:32.069970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f4ac3-1944-4c73-9d10-7cd4ad1c9659 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:32.072669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 743/1486] 10.222.0.65 () {54 vars in 962 bytes} [Thu Dec 23 11:53:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:32.079427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bbe1-418b-4ba4-bc54-ca9205b74fb2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:32.079723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bbe1-418b-4ba4-bc54-ca9205b74fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:32.079990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2bbe1-418b-4ba4-bc54-ca9205b74fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:32.101249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d1e2bbe1-418b-4ba4-bc54-ca9205b74fb2 None None] MFA Rules not processed for user `049a0120570d4d6e94d4d10a7460226d`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:32.102440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d1e2bbe1-418b-4ba4-bc54-ca9205b74fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:32.110118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 744/1487] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Dec 23 11:53:32 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:32.118437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f4ac3-1944-4c73-9d10-7cd4ad1c9659 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:32.130664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f4ac3-1944-4c73-9d10-7cd4ad1c9659 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:32.135123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:32.135756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:32.136040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:32.136316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:32.145464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:32.146931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea918b-d192-401d-af1b-1dbd2bf03073 service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:32.156696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 744/1488] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:34.587035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547847-7083-45b1-b83c-4a99f7fa2200 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:34.587758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547847-7083-45b1-b83c-4a99f7fa2200 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:34.587758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547847-7083-45b1-b83c-4a99f7fa2200 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:34.590485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 745/1489] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:34.601073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b008-0f92-4411-902b-a61863005069 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:34.601513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b008-0f92-4411-902b-a61863005069 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:34.601680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b008-0f92-4411-902b-a61863005069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:34.621979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ef98b008-0f92-4411-902b-a61863005069 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:34.623104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ef98b008-0f92-4411-902b-a61863005069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:34.631307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 745/1490] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:34.655132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0547847-7083-45b1-b83c-4a99f7fa2200 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:34.671864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0547847-7083-45b1-b83c-4a99f7fa2200 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:34.680048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:34.680702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:34.680981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:34.681254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:34.682008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:34.683940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f4ad7-e856-4ae2-8629-89d4cf7abe71 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:34.698061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 746/1491] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Dec 23 11:53:34 2021] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:53:37.050477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511fd4-85ed-450c-8a4c-d0f4cf97135b None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:37.051077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511fd4-85ed-450c-8a4c-d0f4cf97135b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:37.051077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f511fd4-85ed-450c-8a4c-d0f4cf97135b None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:37.052850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 746/1492] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:37.059887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb716-f1e1-4f2a-ba7d-b3422f53e20f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:37.060356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb716-f1e1-4f2a-ba7d-b3422f53e20f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:37.060453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bb716-f1e1-4f2a-ba7d-b3422f53e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:37.082092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b49bb716-f1e1-4f2a-ba7d-b3422f53e20f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:37.083313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b49bb716-f1e1-4f2a-ba7d-b3422f53e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:37.092527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 747/1493] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:37.136363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511fd4-85ed-450c-8a4c-d0f4cf97135b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:37.160355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f511fd4-85ed-450c-8a4c-d0f4cf97135b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:37.168433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:37.169071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:37.169352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:37.169627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:37.178615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:37.180218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97dcf-d64a-4c04-bb97-1bb09eaf15eb service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:37.189974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 747/1494] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:39.739278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787f9f-62c8-4a76-abe7-ad17697889cf None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:39.740124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787f9f-62c8-4a76-abe7-ad17697889cf None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:39.740124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787f9f-62c8-4a76-abe7-ad17697889cf None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:39.742328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 748/1495] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:39.748323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c3f0-61cb-498b-a3cd-0d8af60aecfc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:39.748788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c3f0-61cb-498b-a3cd-0d8af60aecfc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:39.748898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c3f0-61cb-498b-a3cd-0d8af60aecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:39.769042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d585c3f0-61cb-498b-a3cd-0d8af60aecfc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:39.770204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d585c3f0-61cb-498b-a3cd-0d8af60aecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:39.778679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 748/1496] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:53:39.820015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787f9f-62c8-4a76-abe7-ad17697889cf None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:39.836658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787f9f-62c8-4a76-abe7-ad17697889cf None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:39.840671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:39.841306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:39.841578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:39.841843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:39.851728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:39.853161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60ee6a-2bdf-4d09-889d-dd4242546222 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:39.862662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 749/1497] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:42.327794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122b6e-6816-488b-92ba-6d51fd638422 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:42.328725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122b6e-6816-488b-92ba-6d51fd638422 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:42.328725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122b6e-6816-488b-92ba-6d51fd638422 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:42.331641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 749/1498] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:42.338592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179f3-f221-44f7-ba2f-3849209965cd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:42.339017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179f3-f221-44f7-ba2f-3849209965cd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:42.339133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179f3-f221-44f7-ba2f-3849209965cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:42.362267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-531179f3-f221-44f7-ba2f-3849209965cd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:42.363801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-531179f3-f221-44f7-ba2f-3849209965cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:42.372738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 750/1499] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:42.411581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122b6e-6816-488b-92ba-6d51fd638422 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:42.424599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122b6e-6816-488b-92ba-6d51fd638422 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:42.429153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:42.429782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:42.430055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:42.430317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:42.440187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:42.441608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913f4c-6b2a-4171-88f9-bfdc2f601f0b service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:42.451573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 750/1500] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:53:44.896621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c57ad-cdde-4666-99c3-976bb45dca9a None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:44.897527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c57ad-cdde-4666-99c3-976bb45dca9a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:44.897766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c57ad-cdde-4666-99c3-976bb45dca9a None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:44.899623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 751/1501] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:44.905563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:44.906007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:44.906234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:44.925875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:44.927082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:44.935659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 751/1502] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:53:44.971738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c57ad-cdde-4666-99c3-976bb45dca9a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:44.987043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c57ad-cdde-4666-99c3-976bb45dca9a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:44.993144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:44.994037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:44.994285 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:44.994612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:44.995927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:44.998321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dce95-5693-4bc3-8f8e-09d932f793d9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:45.000184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 752/1503] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:53:44 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:53:45.015617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:45.028820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd5f3a-238b-4379-bce1-48c371300cf8 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:45.032809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:45.033464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:45.033747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:45.034020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:45.043540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:45.044984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b7a52-11a0-42e1-ae94-bd892df3286a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:45.055046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 752/1504] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:53:47.590309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e92fe-fb5b-402b-80f7-36d51f9df56a None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:47.590987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e92fe-fb5b-402b-80f7-36d51f9df56a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:47.590987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e92fe-fb5b-402b-80f7-36d51f9df56a None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:47.592699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 753/1505] 10.222.0.65 () {54 vars in 926 bytes} [Thu Dec 23 11:53:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:53:47.599898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:47.600608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:47.600881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:47.620806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:53:47.621931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:53:47.630908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 753/1506] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Dec 23 11:53:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:53:47.665722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e92fe-fb5b-402b-80f7-36d51f9df56a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:47.688932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e92fe-fb5b-402b-80f7-36d51f9df56a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:47.701239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:47.702108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:47.702387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:47.702718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] PATH_INFO: `/v3/projects/174ef43af8a44f289a307527e69c1f4f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:47.704124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] RBAC: Authorizing `identity:get_project(project_id=174ef43af8a44f289a307527e69c1f4f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:47.705936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea18b-12da-4dbd-8f20-1c118ccd3b0c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:47.707722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 754/1507] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Dec 23 11:53:47 2021] GET /identity/v3/projects/174ef43af8a44f289a307527e69c1f4f => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:53:47.722827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:53:47.733717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968ad3d-181b-40cb-aa3b-f6959cf83a08 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:53:47.738276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:53:47.738972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:53:47.739253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:53:47.739528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:53:47.749680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:53:47.751174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ceadf-8df8-478e-a5d9-0c55c16358a6 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:53:47.761339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 754/1508] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:53:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:55:01.046353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.047012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.047012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.073359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:55:01.074596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:01.084110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 755/1509] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:55:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:55:01.092610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.093099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.093206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.112685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:55:01.114258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:01.123475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 755/1510] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:55:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:55:01.128369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.139065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0cd5b-f4cc-4fea-ae9d-41378b1f9f7a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.144372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.145034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.145341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.145616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.146546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:55:01.146860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.148492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.161769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 756/1511] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:55:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:55:01.169957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.179437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17f27-9693-42fc-adba-b014d950e636 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.185418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.186248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.186499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.186939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.187770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.190010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.253616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.257348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 756/1512] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:55:01 2021] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:55:01.273501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22569-df4d-4e18-82ac-a72db4c51698 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.340423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.341153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.341682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.342028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.342895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.344865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.374363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 757/1513] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:55:01 2021] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:55:01.378373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.389789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d4d9-5f61-4532-ba11-d8a591fe04ac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.394473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.395185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.395514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.395804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.396553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.398384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.412696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 757/1514] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:55:01.417158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.427761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332f23f-c98f-42df-92ec-63678e282396 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.434017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.434761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.435045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.435318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.436076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.437677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0187e11-0695-47f8-829f-4f041b562ffc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.453069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 758/1515] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:55:01.457616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.468708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e9be-7e70-4b47-bbdd-ab3ab1862d68 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.473879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.475493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.475778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.476054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] PATH_INFO: `/v3/projects/33b84284c0954e7f88ba9aef6faac90d/users/f86edc0730854936907bcd9ed132980e/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.492617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b84284c0954e7f88ba9aef6faac90d, user_id=f86edc0730854936907bcd9ed132980e, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.495730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.511694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 758/1516] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:55:01 2021] PUT /identity/v3/projects/33b84284c0954e7f88ba9aef6faac90d/users/f86edc0730854936907bcd9ed132980e/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:55:01.524351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11a28-f856-42e6-94b9-1237c27684a7 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.524702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11a28-f856-42e6-94b9-1237c27684a7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.525064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11a28-f856-42e6-94b9-1237c27684a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.563675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-58f11a28-f856-42e6-94b9-1237c27684a7 None None] MFA Rules not processed for user `f86edc0730854936907bcd9ed132980e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:55:01.564916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-58f11a28-f856-42e6-94b9-1237c27684a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:01.639601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 759/1517] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:55:01 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:55:01.655893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.758884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bfb6d-d8b0-41aa-b67c-284ae71eac31 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.765442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.766093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.766375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.766676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.775008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.776597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:01.785435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 759/1518] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:55:01 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:55:01.854440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb8f9-16e8-4d73-a117-9352db0bfd0c None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.854783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb8f9-16e8-4d73-a117-9352db0bfd0c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.855061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cb8f9-16e8-4d73-a117-9352db0bfd0c None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.856793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 760/1519] 10.222.0.65 () {52 vars in 829 bytes} [Thu Dec 23 11:55:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:55:01.860726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:01.927416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6d103-49d2-4436-8fb0-6b82409ab322 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:01.932655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:01.933533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:01.933814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:01.934085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] PATH_INFO: `/v3/users/f86edc0730854936907bcd9ed132980e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:01.935353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86edc0730854936907bcd9ed132980e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:01.936589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:55:01.936589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:55:01.936589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:55:01.937648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:02.005363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86edc0730854936907bcd9ed132980e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.018294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86edc0730854936907bcd9ed132980e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.019125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86edc0730854936907bcd9ed132980e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.032237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86edc0730854936907bcd9ed132980e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.054380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86edc0730854936907bcd9ed132980e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.061049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 760/1520] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:55:01 2021] DELETE /identity/v3/users/f86edc0730854936907bcd9ed132980e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:55:02.066753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:02.067255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:02.067369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:02.086399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:55:02.087632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:02.159170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 761/1521] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:55:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:55:02.169842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:02.171457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:02.234567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3aa46-8a09-447e-b958-cfbe58db3c16 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:02.238534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:02.239203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:02.239481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:02.239752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:02.249407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:02.250907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de02ec-7ff1-41d7-b82c-89dcec81f27a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:02.260266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 761/1522] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:55:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:55:02.585518 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:55:02.587275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:55:02.599291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484efdc-27a2-45fb-a9dd-95f9223b421f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:55:02.609348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:55:02.610259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:55:02.610547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:55:02.610854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] PATH_INFO: `/v3/projects/33b84284c0954e7f88ba9aef6faac90d` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:55:02.612138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b84284c0954e7f88ba9aef6faac90d)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:55:02.613484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:55:02.613484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:55:02.613484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:55:02.614690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:55:02.686324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b84284c0954e7f88ba9aef6faac90d', 'request_id': 'req-fb64c390-e046-4866-b348-2dc02959f95e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.696331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b84284c0954e7f88ba9aef6faac90d', 'request_id': 'req-fb64c390-e046-4866-b348-2dc02959f95e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.702438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b84284c0954e7f88ba9aef6faac90d', 'request_id': 'req-fb64c390-e046-4866-b348-2dc02959f95e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.720717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] The token cache is being invalidate because project 33b84284c0954e7f88ba9aef6faac90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:55:02.721003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.721720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fb64c390-e046-4866-b348-2dc02959f95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:55:02.723520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 762/1523] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:55:02 2021] DELETE /identity/v3/projects/33b84284c0954e7f88ba9aef6faac90d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:56:33.629073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:33.629773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:33.629773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:33.631564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 762/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:33.638857 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4fe-0123-4945-b4a1-97c761481335 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:33.639583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4fe-0123-4945-b4a1-97c761481335 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:33.639745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083b4fe-0123-4945-b4a1-97c761481335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:33.662120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3083b4fe-0123-4945-b4a1-97c761481335 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:33.663548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3083b4fe-0123-4945-b4a1-97c761481335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:33.732327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 763/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:33.889970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:33.892812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:33.972128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811a62b-4d70-483b-a000-6dc750a21c2f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:33.980040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:33.980707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:33.980969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:33.981238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:33.991241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:33.992925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fff1-8c4e-4625-aa7f-df6e8c835830 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:34.003273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 763/1526] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:35.503072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8caf53-cdf4-41d3-be11-68a9167d5ccf None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:35.503956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8caf53-cdf4-41d3-be11-68a9167d5ccf None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:35.503956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8caf53-cdf4-41d3-be11-68a9167d5ccf None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:35.507540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 764/1527] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:56:35 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:35.514249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783061-9256-4daa-9d83-86609ada4618 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:35.514736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783061-9256-4daa-9d83-86609ada4618 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:35.514963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783061-9256-4daa-9d83-86609ada4618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:35.536083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-97783061-9256-4daa-9d83-86609ada4618 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:35.537617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-97783061-9256-4daa-9d83-86609ada4618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:35.547026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 764/1528] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:56:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:56:35.702259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8caf53-cdf4-41d3-be11-68a9167d5ccf None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:35.718777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8caf53-cdf4-41d3-be11-68a9167d5ccf None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:35.725444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:35.726091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:35.726375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:35.726682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:35.735326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:35.736918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b2ddc-7092-447c-8578-eed5f3583f44 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:35.746466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 765/1529] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:35.767699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb81a-5f6d-460b-960d-3280731754d9 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:35.767980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb81a-5f6d-460b-960d-3280731754d9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:35.768240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb81a-5f6d-460b-960d-3280731754d9 None None] PATH_INFO: `/v3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:35.769543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 765/1530] 10.222.0.61 () {54 vars in 925 bytes} [Thu Dec 23 11:56:35 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:56:35.778423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaefbbd-257f-4eb4-bb78-b570a119ea14 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:35.778743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaefbbd-257f-4eb4-bb78-b570a119ea14 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:35.779020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaefbbd-257f-4eb4-bb78-b570a119ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:35.801950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9aaefbbd-257f-4eb4-bb78-b570a119ea14 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:35.803426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9aaefbbd-257f-4eb4-bb78-b570a119ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:35.871329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 766/1531] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Dec 23 11:56:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:47.136920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e1-b1a1-4332-b8b6-d09c8e356700 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.137438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e1-b1a1-4332-b8b6-d09c8e356700 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.137438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b975e1-b1a1-4332-b8b6-d09c8e356700 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.139361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 766/1532] 10.222.0.65 () {54 vars in 960 bytes} [Thu Dec 23 11:56:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:47.145071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c725a-a427-4905-b6ff-0d5f43de4276 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.145549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c725a-a427-4905-b6ff-0d5f43de4276 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.145648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c725a-a427-4905-b6ff-0d5f43de4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.165693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-fc0c725a-a427-4905-b6ff-0d5f43de4276 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:47.166905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fc0c725a-a427-4905-b6ff-0d5f43de4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:47.176682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 767/1533] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Dec 23 11:56:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:47.184726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b975e1-b1a1-4332-b8b6-d09c8e356700 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:47.198787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b975e1-b1a1-4332-b8b6-d09c8e356700 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:47.204142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:47.204853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.205206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.205550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.214848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:47.216499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba37e9-8645-4571-83e2-caaf8a841c4c service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:47.225999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 767/1534] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:47.646870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718422a-d9cc-40d7-8f9a-90b60c91b705 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.647157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718422a-d9cc-40d7-8f9a-90b60c91b705 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.647462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718422a-d9cc-40d7-8f9a-90b60c91b705 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.649531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 768/1535] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:56:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 23 11:56:47.655172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f37b-df3e-4cc7-b2a3-034dfce1a9e5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.655453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f37b-df3e-4cc7-b2a3-034dfce1a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.655723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6f37b-df3e-4cc7-b2a3-034dfce1a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.675243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-98a6f37b-df3e-4cc7-b2a3-034dfce1a9e5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:47.676442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-98a6f37b-df3e-4cc7-b2a3-034dfce1a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:47.685197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 768/1536] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:47.841100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718422a-d9cc-40d7-8f9a-90b60c91b705 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:47.860575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718422a-d9cc-40d7-8f9a-90b60c91b705 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:47.868041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:47.868674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:47.868955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:47.869228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:47.877476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:47.879113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bf6a3-415c-4fdd-96aa-3124188e1dc3 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:47.888383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 769/1537] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:49.371538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd11bae-7691-45e6-bc13-56af1f9ff3c7 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:49.372030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd11bae-7691-45e6-bc13-56af1f9ff3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:49.372030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd11bae-7691-45e6-bc13-56af1f9ff3c7 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:49.374871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 769/1538] 127.0.0.1 () {54 vars in 901 bytes} [Thu Dec 23 11:56:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:49.384283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f506c-d708-4e45-90d1-9ff1360e211d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:49.384705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f506c-d708-4e45-90d1-9ff1360e211d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:49.384876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f506c-d708-4e45-90d1-9ff1360e211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:49.409376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-479f506c-d708-4e45-90d1-9ff1360e211d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:49.410615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-479f506c-d708-4e45-90d1-9ff1360e211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:49.419321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 770/1539] 127.0.0.1 () {58 vars in 998 bytes} [Thu Dec 23 11:56:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:49.574068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd11bae-7691-45e6-bc13-56af1f9ff3c7 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:49.591001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd11bae-7691-45e6-bc13-56af1f9ff3c7 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:49.597202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:49.597837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:49.598114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:49.598383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:49.607067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:49.608651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e846ad-0f45-467d-833a-e30fbf33b47a service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:49.618666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 770/1540] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:53.705783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:53.706713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:53.706713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:53.709567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 771/1541] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:56:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:53.715509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0bf09-7203-4234-b5ca-91d6dbb803b7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:53.715979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0bf09-7203-4234-b5ca-91d6dbb803b7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:53.716092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0bf09-7203-4234-b5ca-91d6dbb803b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:53.735461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9ba0bf09-7203-4234-b5ca-91d6dbb803b7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:53.736625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9ba0bf09-7203-4234-b5ca-91d6dbb803b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:53.745240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 771/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:56:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:53.786932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:53.790202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:53.855335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bdc6b-1450-4331-8cb8-557e2dd48c49 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:53.860461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:53.861116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:53.861392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:53.861664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:53.872204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:53.873626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da728-7a5e-4779-a489-424f7c7c50fc service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:53.883130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 772/1543] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:56:56.219957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196828f-0396-43a3-95d4-a42d183d3193 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:56.220561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196828f-0396-43a3-95d4-a42d183d3193 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:56.220561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196828f-0396-43a3-95d4-a42d183d3193 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:56.222323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 772/1544] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:56:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:56:56.231894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cba32-86aa-4f16-9cff-586989822fc5 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:56.232396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cba32-86aa-4f16-9cff-586989822fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:56.232499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cba32-86aa-4f16-9cff-586989822fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:56.256324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6c7cba32-86aa-4f16-9cff-586989822fc5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:56:56.257521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6c7cba32-86aa-4f16-9cff-586989822fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:56:56.267585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 773/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:56:56.307186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196828f-0396-43a3-95d4-a42d183d3193 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:56:56.322765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196828f-0396-43a3-95d4-a42d183d3193 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:56:56.328942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:56:56.329918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:56:56.330337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:56:56.330805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:56:56.341993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:56:56.343476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8d6f6-71a6-418f-bf6e-dc6239c30957 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:56:56.353577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 773/1546] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:56:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:57:00.350671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:00.351251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:00.351251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:00.353238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 774/1547] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:57:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:57:00.359918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181f15-08d7-4b92-b892-5214795e17fe None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:00.359918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181f15-08d7-4b92-b892-5214795e17fe None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:00.360400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d181f15-08d7-4b92-b892-5214795e17fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:00.380319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8d181f15-08d7-4b92-b892-5214795e17fe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:57:00.381504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8d181f15-08d7-4b92-b892-5214795e17fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:57:00.390366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 774/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:57:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:57:00.444451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:57:00.447211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:57:00.520309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de6b8f-4663-4602-94a9-db7a429323f9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:57:00.524612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:57:00.525295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:00.525569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:00.525842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:00.535273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:57:00.536703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63c1ba-7e3b-4062-9404-627c46c32adc service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:57:00.546668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 775/1549] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:57:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:57:02.917740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30907a-3aab-487b-a5a4-4da3de1788d2 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:02.918370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30907a-3aab-487b-a5a4-4da3de1788d2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:02.918370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30907a-3aab-487b-a5a4-4da3de1788d2 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:02.920151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 775/1550] 127.0.0.1 () {54 vars in 916 bytes} [Thu Dec 23 11:57:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:57:02.929051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710148-0887-49ee-82a3-9e8d7e1740b3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:02.929575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710148-0887-49ee-82a3-9e8d7e1740b3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:02.929819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710148-0887-49ee-82a3-9e8d7e1740b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:02.952761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9c710148-0887-49ee-82a3-9e8d7e1740b3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:57:02.953980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9c710148-0887-49ee-82a3-9e8d7e1740b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:57:02.964759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 776/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Dec 23 11:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:57:03.019687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaad24-78bf-4a10-903f-73d731398ecb None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:03.020026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaad24-78bf-4a10-903f-73d731398ecb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:03.020282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaad24-78bf-4a10-903f-73d731398ecb None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:03.022236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 776/1552] 10.222.0.65 () {54 vars in 963 bytes} [Thu Dec 23 11:57:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:57:03.029442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04d792-4a69-42fd-92b1-30290b084b35 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:03.029734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04d792-4a69-42fd-92b1-30290b084b35 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:03.029995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04d792-4a69-42fd-92b1-30290b084b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:03.053967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8c04d792-4a69-42fd-92b1-30290b084b35 None None] MFA Rules not processed for user `16cff1dd38b24c53b75703647fddd213`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:57:03.055545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c04d792-4a69-42fd-92b1-30290b084b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:57:03.064025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 777/1553] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Dec 23 11:57:03 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:57:03.074581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaad24-78bf-4a10-903f-73d731398ecb None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:57:03.086953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaad24-78bf-4a10-903f-73d731398ecb None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:57:03.091256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:57:03.091927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:57:03.092406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:57:03.092923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:57:03.105380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:57:03.106984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d39e45-6cb3-4f86-a861-6e8e1a037e9a service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:57:03.120162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 777/1554] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:57:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:26.293199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.295784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.295784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.320326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.321881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.334822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 778/1555] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:26.344161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563543e0-ee7d-462a-b412-2551d39fb3ae None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.346050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563543e0-ee7d-462a-b412-2551d39fb3ae None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.346975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563543e0-ee7d-462a-b412-2551d39fb3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.380741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-563543e0-ee7d-462a-b412-2551d39fb3ae None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.382916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-563543e0-ee7d-462a-b412-2551d39fb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.394872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 778/1556] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:26.399984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.414418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fb89-1367-4800-a2ae-1d974a3ac66b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.415281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fb89-1367-4800-a2ae-1d974a3ac66b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.417679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d173c2-fc71-4982-9ea9-db361da71a6c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.418851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138fb89-1367-4800-a2ae-1d974a3ac66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.427808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.428790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.429258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.430836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.431795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:26.432904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.438615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.460838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c138fb89-1367-4800-a2ae-1d974a3ac66b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.463915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c138fb89-1367-4800-a2ae-1d974a3ac66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.469173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 779/1557] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:26.478796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.487661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 779/1558] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.493129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a919e-6bde-4471-83c9-bd5c969292be admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.502274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865897ec-e9e0-4584-b371-b4a478381964 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.502877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865897ec-e9e0-4584-b371-b4a478381964 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.503175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.503705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865897ec-e9e0-4584-b371-b4a478381964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.504053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.504338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.504607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.505370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.507332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1d907-41d7-4774-a705-7e7c0ad894d7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.535705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-865897ec-e9e0-4584-b371-b4a478381964 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.537517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-865897ec-e9e0-4584-b371-b4a478381964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.553516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 780/1559] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:26.555297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13bab-2f63-4cee-9dc6-12a81ae69791 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.555951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13bab-2f63-4cee-9dc6-12a81ae69791 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.556447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13bab-2f63-4cee-9dc6-12a81ae69791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.562548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 780/1560] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:26.562548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.562548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.562548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.583507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-30b13bab-2f63-4cee-9dc6-12a81ae69791 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.592076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-30b13bab-2f63-4cee-9dc6-12a81ae69791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.592357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.594198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.686223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 781/1561] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.687677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.688236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.688523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.707971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 781/1562] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.708881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.716226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.718118 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.721930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8afda-fe70-428e-899d-c8423dccd1b3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.726731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 782/1563] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.727348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.731989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.732691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.732976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.733391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.734161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:26.734459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.736370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cc96d-8ebf-457b-ac0b-77f72f91013d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.744559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ff4f-9e5d-4166-b929-ace38d3fe3ee None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.749681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.750149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 782/1564] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:26.750347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.750725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.751009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.751353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3458-047d-4835-ad6f-9ae8dbd559dd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.751645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3458-047d-4835-ad6f-9ae8dbd559dd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.751755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.751918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3458-047d-4835-ad6f-9ae8dbd559dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.753800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f72c53-9f2e-4d7d-9074-31580c276a58 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.769778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1fde3458-047d-4835-ad6f-9ae8dbd559dd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.771228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1fde3458-047d-4835-ad6f-9ae8dbd559dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.779245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 783/1565] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:26.779245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29579-ef38-417a-a76c-3ca1e1b60d52 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.779245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29579-ef38-417a-a76c-3ca1e1b60d52 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.779245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29579-ef38-417a-a76c-3ca1e1b60d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.779779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 783/1566] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.780879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86ec9-ffb5-4cbf-941d-2cbfe275a850 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.781166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86ec9-ffb5-4cbf-941d-2cbfe275a850 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.781442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a86ec9-ffb5-4cbf-941d-2cbfe275a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.802297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b9a86ec9-ffb5-4cbf-941d-2cbfe275a850 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.802550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-37c29579-ef38-417a-a76c-3ca1e1b60d52 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.803508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b9a86ec9-ffb5-4cbf-941d-2cbfe275a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.803684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-37c29579-ef38-417a-a76c-3ca1e1b60d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.811462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 784/1567] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.811777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 784/1568] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.812977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.813108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8b05-5c5c-4d6e-bda3-5663f259598e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.813283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8b05-5c5c-4d6e-bda3-5663f259598e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.813391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.813556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df8b05-5c5c-4d6e-bda3-5663f259598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.813672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.836067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-60df8b05-5c5c-4d6e-bda3-5663f259598e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.837336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-60df8b05-5c5c-4d6e-bda3-5663f259598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.838295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.839501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.845457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 785/1569] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.846666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.847115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.847391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.847706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 785/1570] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.848460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.858366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0973-a61a-4833-acc0-85c46db5712d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.863341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.864006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.864288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.864558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.865266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.867257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b04c8-a1ab-49aa-960e-09fcc239cf89 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.867701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.868877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.876773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 786/1571] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.877541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.886734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144591a-cd6d-4290-b742-f865155de9d8 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.891472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.892126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.892400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.892669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.893400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.895033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.899998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 786/1572] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:26.899998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e29e8-d799-4df0-9bca-c2cbfe3ea12c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.899998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e29e8-d799-4df0-9bca-c2cbfe3ea12c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.899998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e29e8-d799-4df0-9bca-c2cbfe3ea12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.905974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 787/1573] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:26.906963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.916792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3515b-7394-4d5f-98b1-ceb8d42ca8fa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:26.920709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ab1e29e8-d799-4df0-9bca-c2cbfe3ea12c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:26.921905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ab1e29e8-d799-4df0-9bca-c2cbfe3ea12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:26.972088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:26.972928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.973272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.973533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.974269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:26.974601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:26.976203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:26.980333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 787/1574] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:26.981766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:26.982049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:26.982338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:26.988670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 788/1575] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:26.989498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:26.999135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6a45a-d78d-4f62-934b-cf430c895ea2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.004259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.004924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.005199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.005466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.006193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:27.006504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.007516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:27.008173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e07b53-d73b-4f57-ac41-5fe67c795574 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.008694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:27.017134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 788/1576] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:27.017915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.020452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 789/1577] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:27.021873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.022333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.022792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.027082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963996f-fbbc-4b97-a01b-a42068efe021 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.031885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.032533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.032808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.033075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.033810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:27.034103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.035730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.040338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:27.041527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:27.047125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 789/1578] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:27.047125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.053650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 790/1579] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:27.053650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.062445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695a7f-368e-46fa-a6ed-04e054bf0907 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.062635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa468-eb5b-414e-9d69-7a4fa715c992 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.066838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.066982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.067489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.067590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.067764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.067868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.068034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.068154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.068725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.068838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.070352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.070623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.080730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 791/1580] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.081988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.091937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 790/1581] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.092489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a064-3b7e-43cc-9a2b-45878263ce21 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.095670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.097343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.098136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.098413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.098727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.099460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:27.099767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.101406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.105409 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd65037-b7d6-442c-8a0d-6c2ca8a24d1d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.110980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.111637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.112289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.112562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.113266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.114270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 792/1582] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:27.115219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.115348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.124909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7890d2-7a46-45cb-b888-b794bf1548e4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.130091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.130775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.131057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.131326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.132066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:27.132351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.133954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.141948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 791/1583] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.143040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.145967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 793/1584] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:27.146850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.156332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e48c-5a2a-4e67-8e43-1015fff37021 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.203946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b4ba-28d0-47c5-b4a2-04bca4fb657e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.208601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.209273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.209551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.209823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.210538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.210684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.211237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.211482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.211748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.212445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.212567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:27.212763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.214337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.228358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 794/1585] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:27.229187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.242310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eaec3-0e7c-4d83-8abe-748a7ab49c30 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.249168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 792/1586] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.249168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.249391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.249391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.249391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.249391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.249736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.250986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.277566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 795/1587] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.278638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.308938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e373c-bb68-416c-9a5d-52c98497d5b7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.338963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbeed-9135-4f6d-bc2a-c51e0a821feb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.344091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.344797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.345390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.345495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.346208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.347970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.361627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 796/1588] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.361627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.365837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.366963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.367240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.367510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] PATH_INFO: `/v3/projects/5887f7f050514497b85cd77003ea7a8e/users/2fd5fa3d5f0545329f8ae695b74aadcc/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.372456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c012-8751-4f12-ae7f-629a8b63a6f5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.377001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.377646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.377930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.378202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.378933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.380850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.381848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5887f7f050514497b85cd77003ea7a8e, user_id=2fd5fa3d5f0545329f8ae695b74aadcc, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.384504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.398906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 793/1589] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:27 2021] PUT /identity/v3/projects/5887f7f050514497b85cd77003ea7a8e/users/2fd5fa3d5f0545329f8ae695b74aadcc/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:27.399844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.413440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 797/1590] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.413440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.464669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d7fc-beb3-483f-9123-cbe75fc31b6c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.469574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.470239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.470366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14b9d4-eeab-48cb-85d9-61a430d5231f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.470543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.470809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.471510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.473414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.475026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.475687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.475968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.476243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.477064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.479177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.492929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 794/1591] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.493821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.503711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bece-2424-49ed-b041-7c4397e7ad41 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.509908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 798/1592] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.509908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.510144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.510144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.510144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.510144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.510531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.512255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.538743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 795/1593] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.539407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.568200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b31c-1df0-4334-bb01-a24500908826 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.598985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc170cf-d1c7-43a2-836f-177e626bae04 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.603573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.604237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.604513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.604781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.605477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.607439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.625202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.625878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.626166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.626442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.627172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.628913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 796/1594] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.629117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62da6b-4f3a-4520-9362-d186c5141213 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.629794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.640864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d91887-faa9-4635-bb10-e14afd42979d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.646383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.647136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.647421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.647812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.648761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.650370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.651910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 799/1595] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.653030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.653325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.653748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.666395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 797/1596] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.666395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.673450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c455-693b-482e-8d26-dbf64c4084a3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.678031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.678703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.678994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.679266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.679959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.681274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] MFA Rules not processed for user `2fd5fa3d5f0545329f8ae695b74aadcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:27.681844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.682493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:27.703211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 798/1597] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.703848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.712871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4ba44-53ef-4712-9f18-5a96f773a589 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.717804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.718450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.718764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.719038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.719767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.721344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.732934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 799/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.733733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.749004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1950-ea06-467f-919a-30db715f08b7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.750573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 800/1599] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:27.751439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.755959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.756697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.757010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.757505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.758148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.760110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.764258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d7af3-985f-4993-b20b-73a6b57a5738 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.769408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.770108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.770386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.770715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.771378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.773647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.782193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 800/1600] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.787569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.801818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 801/1601] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:27 2021] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:27.801818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.802139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36fc22-8dd8-4889-a01e-0b80444b8652 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.805803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.806469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.806779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.807054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.807798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.808975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570485-54c1-4dde-bbfc-dc59fb314a5f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.809390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.814117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.814809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.815086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.815360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.816153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.817752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.820166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 801/1602] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.820166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.831581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 802/1603] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.831581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.831853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7398d42-1670-4d19-8b8b-22de8976e917 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.836082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.836951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.837232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.837508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] PATH_INFO: `/v3/projects/cf852b4ffd784cc6a4c15059be11f5c8/users/9b39dd77d85e4eb1bc76c00e071e97c6/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.838815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6a501-167c-4f61-b9dd-d201f3f54fb5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.843466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.844122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.844415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.844682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.845427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.847146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.855232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf852b4ffd784cc6a4c15059be11f5c8, user_id=9b39dd77d85e4eb1bc76c00e071e97c6, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.858797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 803/1604] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.859536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.859700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.871256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b66e-0975-42a0-8841-6359ed4308b1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.874452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 802/1605] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:27 2021] PUT /identity/v3/projects/cf852b4ffd784cc6a4c15059be11f5c8/users/9b39dd77d85e4eb1bc76c00e071e97c6/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:27.879521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.936912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.937599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.937864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.938133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.938940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.940543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caba1b-7c00-40a5-9bc1-a3cbab6482bb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.947320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dc112-0c7f-434f-967e-f1c860148a07 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.955597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 804/1606] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.955597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e1f89-bd48-4cd8-a20d-0f9f472c66bc None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.955597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e1f89-bd48-4cd8-a20d-0f9f472c66bc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.955970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.956102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e1f89-bd48-4cd8-a20d-0f9f472c66bc None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.956196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.956196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.956196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.956443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 805/1607] 10.222.0.65 () {54 vars in 961 bytes} [Thu Dec 23 11:58:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:27.956443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e1f89-bd48-4cd8-a20d-0f9f472c66bc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.958591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.960432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.968014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e1f89-bd48-4cd8-a20d-0f9f472c66bc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.971400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 803/1608] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.972291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.975470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.976113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.976395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.976673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.977649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.979375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:27.981573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a705-974b-46fb-9fa7-3eb2750f1e8f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:27.986386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:27.987442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:27.987717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:27.987987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:27.988709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:27.990246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 806/1609] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:27.990912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:27.993323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.000173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb66095-2509-48b2-aac6-2c0eddeafde6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.007271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 804/1610] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:28.007271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.007796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.008447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.008728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.009000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.009740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.011367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65009d-5750-41fc-b644-d8f1637eb972 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.016284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589553-fce8-4618-9cd7-7dd10ce45968 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.020858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.021498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.021777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.022049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.022370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 807/1611] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:28.022803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.023694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3ec7-f19c-4108-862a-ec95afa430f8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.023980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3ec7-f19c-4108-862a-ec95afa430f8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.024248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3ec7-f19c-4108-862a-ec95afa430f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.024472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.034549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 805/1612] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:28.037879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.041794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d9ff3ec7-f19c-4108-862a-ec95afa430f8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.043032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d9ff3ec7-f19c-4108-862a-ec95afa430f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.044707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749dd8-5d3a-4e57-940e-294d2f808cc6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.049404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.050270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.050571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.050873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] PATH_INFO: `/v3/projects/674458dc864c496db9e2732be043b1e3/users/f46a8ad111c54e158adcb2745f832cac/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.052344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 808/1613] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.054347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.054347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.054347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.066252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674458dc864c496db9e2732be043b1e3, user_id=f46a8ad111c54e158adcb2745f832cac, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.068930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.073235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.074374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.082467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 806/1614] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/674458dc864c496db9e2732be043b1e3/users/f46a8ad111c54e158adcb2745f832cac/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.083448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.141543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 809/1615] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.142416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.145134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8fcbf-c74b-4987-a924-346c0568deb0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.150246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.150984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.151267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.151539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.152279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.152506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961286-512c-4722-8f17-fb193e5fb656 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.154121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.157542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.158183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.158472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.158807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.159554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.161165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.164454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 807/1616] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:28.165367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.171805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 810/1617] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:28.172590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.174528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54932eba-ec02-4dfc-939e-08dbaed8b511 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.179041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.179899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.180173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.180444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] PATH_INFO: `/v3/projects/041f7ef0362a483db89902d1d01979bc/users/720a69bd1ef943fd940d02e4739d1e06/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.184042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b253a6-1dac-4b58-add4-7a3decea1874 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.189229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.190099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.190376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.190753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] PATH_INFO: `/v3/projects/e6c655658b5f4f53b4145ea20afcf1d4/users/804530daa2704fcdb1fef91615b62c99/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.194873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=041f7ef0362a483db89902d1d01979bc, user_id=720a69bd1ef943fd940d02e4739d1e06, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.197485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.205104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c655658b5f4f53b4145ea20afcf1d4, user_id=804530daa2704fcdb1fef91615b62c99, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.208007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.211128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 808/1618] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/041f7ef0362a483db89902d1d01979bc/users/720a69bd1ef943fd940d02e4739d1e06/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.212000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.230058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 811/1619] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/e6c655658b5f4f53b4145ea20afcf1d4/users/804530daa2704fcdb1fef91615b62c99/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.230952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.272445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74fe48-550d-4594-929e-257216ebd72f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.284719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5355-3fd6-4a40-a1d5-2505015c5750 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.288582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.289229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.289510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.289780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.325377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.326843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.327133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.327397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] PATH_INFO: `/v3/projects/645cdb6dacb842d596763f1cc0db0ea8/users/78104233add8401d94cca634c3541b42/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.340942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=645cdb6dacb842d596763f1cc0db0ea8, user_id=78104233add8401d94cca634c3541b42, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.344319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a5ef7-60c3-430c-8e14-ca15e196e34d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.348927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.350643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.360136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 809/1620] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/645cdb6dacb842d596763f1cc0db0ea8/users/78104233add8401d94cca634c3541b42/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.361665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.362293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.362613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.367958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 812/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:28.369005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.389593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] MFA Rules not processed for user `f46a8ad111c54e158adcb2745f832cac`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.391230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.447885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9093-9463-4dfe-8520-a1cce0e0a627 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.459181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 810/1622] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.460031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.523523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd999ef6-7efd-4993-a8ec-b4000a1566c9 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.525536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.526195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.526472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.526848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.528403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.529518 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.530045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.530328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] PATH_INFO: `/v3/projects/3d63ec44670b46eabfde6472f6f6dc5e/users/536461eca51742caa717d537d24c3adb/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.549710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d63ec44670b46eabfde6472f6f6dc5e, user_id=536461eca51742caa717d537d24c3adb, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.553331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.569747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 811/1623] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/3d63ec44670b46eabfde6472f6f6dc5e/users/536461eca51742caa717d537d24c3adb/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.579690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.588516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.590148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c437cec-f93c-448a-86b0-aa5b4d349422 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.599980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 813/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:28.601418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1a05-3c29-4e97-b621-4c44236af061 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.601619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1a05-3c29-4e97-b621-4c44236af061 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.601886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d1a05-3c29-4e97-b621-4c44236af061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.630549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d21d1a05-3c29-4e97-b621-4c44236af061 None None] MFA Rules not processed for user `720a69bd1ef943fd940d02e4739d1e06`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.631828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d21d1a05-3c29-4e97-b621-4c44236af061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.657036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf4c8-0cf6-405a-a186-a1104df1451e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.662465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.664061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.664555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.665092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] PATH_INFO: `/v3/projects/ec59363a116e4c37832626c6add07f04/users/3f41f3bd3c1142aca50069a45a26aaaa/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.683799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec59363a116e4c37832626c6add07f04, user_id=3f41f3bd3c1142aca50069a45a26aaaa, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.687985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa519a4b-812c-452d-a82a-1ce200f85c83 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.708702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 814/1625] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.710097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.710382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.710683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.718269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 812/1626] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:28 2021] PUT /identity/v3/projects/ec59363a116e4c37832626c6add07f04/users/3f41f3bd3c1142aca50069a45a26aaaa/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:28.718269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13cc3-e5b5-432e-ab59-69be6f8d1a40 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.718562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13cc3-e5b5-432e-ab59-69be6f8d1a40 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.720032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13cc3-e5b5-432e-ab59-69be6f8d1a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.740799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.742162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.751185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a2b13cc3-e5b5-432e-ab59-69be6f8d1a40 None None] MFA Rules not processed for user `78104233add8401d94cca634c3541b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.752474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a2b13cc3-e5b5-432e-ab59-69be6f8d1a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.824298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 815/1627] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.825777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.859046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 813/1628] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.859046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.859046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.859046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.895286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] MFA Rules not processed for user `536461eca51742caa717d537d24c3adb`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:28.897013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:28.900568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b719bb-33ce-4389-91a4-78f45f11c8d6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.905796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.906755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.907885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.907885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.976057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 814/1629] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:28.976057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:28.982680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a22118-6e8d-4f94-8622-22b1919577f3 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:28.987569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:28.988231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:28.988509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:28.988778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:28.988894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.989481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:28.990656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d974d2f-fc67-420f-8cd5-4eed15125520 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:28.991413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.001278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 816/1630] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:28 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:29.002705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.003006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.003433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.022246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:29.023789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:29.024997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 815/1631] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:28 2021] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:29.025918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.088291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4c739-507a-4434-ad91-78bd960a36d6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.095587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 817/1632] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:29.096806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.104022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973da11-375a-473b-8949-f880635f789a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.105633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973da11-375a-473b-8949-f880635f789a service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.105938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973da11-375a-473b-8949-f880635f789a service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.106220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973da11-375a-473b-8949-f880635f789a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.108023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5cb7d-f962-4767-a645-f93688d9818a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.113320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.114146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.114489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.114868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.123010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973da11-375a-473b-8949-f880635f789a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.123211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.124461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973da11-375a-473b-8949-f880635f789a service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.126423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.137663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 816/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:29.139452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf458-2545-4d25-a1ae-c01b1229d23d None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.139796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf458-2545-4d25-a1ae-c01b1229d23d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.140092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf458-2545-4d25-a1ae-c01b1229d23d None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.141804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 817/1634] 10.222.0.65 () {54 vars in 912 bytes} [Thu Dec 23 11:58:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:29.146742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b5a-6daa-4c08-803d-6f6b5d372e23 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.147333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b5a-6daa-4c08-803d-6f6b5d372e23 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.147852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae6b5a-6daa-4c08-803d-6f6b5d372e23 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.150359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 818/1635] 10.222.0.65 () {54 vars in 961 bytes} [Thu Dec 23 11:58:29 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:29.151351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae6b5a-6daa-4c08-803d-6f6b5d372e23 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.169187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae6b5a-6daa-4c08-803d-6f6b5d372e23 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.179808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.180691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.181123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.181424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.182241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.186997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e381d-56db-4227-8679-cc06e0685354 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.208779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 818/1636] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:29.210082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.236731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 819/1637] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:29.243041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71734255-e5c7-49c8-9c2b-65cf73e85620 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.244285 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71734255-e5c7-49c8-9c2b-65cf73e85620 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.244603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71734255-e5c7-49c8-9c2b-65cf73e85620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.270629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-71734255-e5c7-49c8-9c2b-65cf73e85620 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:29.273727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-71734255-e5c7-49c8-9c2b-65cf73e85620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:29.357078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059f4d5-ac86-43cf-916a-51f2a06d9ce3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.366464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.367683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.368131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.368777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.382418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 820/1638] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:29.386364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330031-073f-4652-84ce-f73f013b633a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.386678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330031-073f-4652-84ce-f73f013b633a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.386950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330031-073f-4652-84ce-f73f013b633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.433020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-01330031-073f-4652-84ce-f73f013b633a None None] MFA Rules not processed for user `9b39dd77d85e4eb1bc76c00e071e97c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:29.434341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-01330031-073f-4652-84ce-f73f013b633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:29.471662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.474601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85726-814f-4d0e-8b39-899a886fa133 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.498226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 819/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:29.501405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.501707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.501920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.525764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:29.527071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:29.541015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 820/1640] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:29.541015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.542462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 821/1641] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:29.543909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330031-073f-4652-84ce-f73f013b633a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.549569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647652-9688-4cbc-b07e-8420f65f8354 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.560931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.561855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330031-073f-4652-84ce-f73f013b633a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.562723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.563408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.563910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.564909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.567344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9c9c1-801f-4106-9cb9-917ecf4913c8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.568703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.569665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.570135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.570639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.571591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.573406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.596894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 822/1642] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:29.597907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.614978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 821/1643] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:29.616268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.616556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.616847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.655872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] MFA Rules not processed for user `9b39dd77d85e4eb1bc76c00e071e97c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:29.657277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:29.682030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 822/1644] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:29.682030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.695776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e4da-56f2-41bd-9913-531ab314c604 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.704862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.706200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.707977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.708438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.760142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83550f18-cf4d-4e84-9058-c564087bb450 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.772445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.773289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.773571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.774975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.804851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.806329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.813061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.814986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.831844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 823/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:29.833302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.837150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 823/1646] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:29.837836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.864442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31fa7-2efd-4442-bae4-7844617ea5e6 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.875043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320da25-1486-4601-977d-aa6bbe9b3b43 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.877274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.877970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.878246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.878534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.879288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.881041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.886249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.888952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.891341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.891719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] PATH_INFO: `/v3/projects/062d8fbe4d034920a6f7654daff33d91/users/12956d4d1cfe49bcbb9a4c7bbe283dbd/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.905177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 824/1647] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:29.909763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.929694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d1998-7d48-42e8-ae65-ca1d86047501 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:29.942304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062d8fbe4d034920a6f7654daff33d91, user_id=12956d4d1cfe49bcbb9a4c7bbe283dbd, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.944410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:29.945337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:29.945618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:29.945891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] PATH_INFO: `/v3/projects/19b13514c9b44575973e62fbf323d399/users/7d38edeaac2a4d3da7603a2aaf4d6253/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:29.952506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:29.981898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 824/1648] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:29 2021] PUT /identity/v3/projects/062d8fbe4d034920a6f7654daff33d91/users/12956d4d1cfe49bcbb9a4c7bbe283dbd/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:29.983873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b13514c9b44575973e62fbf323d399, user_id=7d38edeaac2a4d3da7603a2aaf4d6253, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:29.985191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:29.986553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.010648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 825/1649] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:29 2021] PUT /identity/v3/projects/19b13514c9b44575973e62fbf323d399/users/7d38edeaac2a4d3da7603a2aaf4d6253/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:30.014994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.125990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232822-0dc9-4514-9837-4d4085045972 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.138797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.139452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.143476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.144004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.146260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.148130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.151828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d0a99-285f-4d53-9912-02f8e0b998a5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.159420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.160389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.160761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.161122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.162076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.164618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.176730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 826/1650] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:30 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:58:30.178209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.210894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 825/1651] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:30.212415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.230785 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19861a5-2f65-4ce3-ab3c-c3a04f08105d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.246981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.248291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.248422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.249411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] PATH_INFO: `/v3/projects/19b13514c9b44575973e62fbf323d399/users/7d38edeaac2a4d3da7603a2aaf4d6253/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.255583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b13514c9b44575973e62fbf323d399, user_id=7d38edeaac2a4d3da7603a2aaf4d6253, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.261297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.290640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 826/1652] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:30 2021] PUT /identity/v3/projects/19b13514c9b44575973e62fbf323d399/users/7d38edeaac2a4d3da7603a2aaf4d6253/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:30.291883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.323078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813262f-9804-455c-bd6c-e17abf77ecc8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.419629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a884d-7f84-4484-8a15-9bb29e40a60a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.425087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.426009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.426290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.426587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] PATH_INFO: `/v3/projects/062d8fbe4d034920a6f7654daff33d91/users/12956d4d1cfe49bcbb9a4c7bbe283dbd/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.428860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062d8fbe4d034920a6f7654daff33d91, user_id=12956d4d1cfe49bcbb9a4c7bbe283dbd, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.431655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5358e9-f70d-4bf3-9901-7ecfa37fe4d4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.445749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 827/1653] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:30 2021] PUT /identity/v3/projects/062d8fbe4d034920a6f7654daff33d91/users/12956d4d1cfe49bcbb9a4c7bbe283dbd/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:30.447069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.449401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.449688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.450914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.457347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.457692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.458183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.492870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] MFA Rules not processed for user `7d38edeaac2a4d3da7603a2aaf4d6253`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:30.494765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:30.561193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.563118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f04aec-81a3-4d5f-97d0-48fa35013fb8 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.573541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 827/1654] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:30 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:30.575204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a4ca2-0926-48f5-8a59-362ba04bbb67 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.575660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a4ca2-0926-48f5-8a59-362ba04bbb67 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.575928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a4ca2-0926-48f5-8a59-362ba04bbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.582285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 828/1655] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:30 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:30.589779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.614995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-135a4ca2-0926-48f5-8a59-362ba04bbb67 None None] MFA Rules not processed for user `12956d4d1cfe49bcbb9a4c7bbe283dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:30.616612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-135a4ca2-0926-48f5-8a59-362ba04bbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:30.720297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 828/1656] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:30 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:30.722208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe08c1-6c0c-424e-8b77-f9b76ad49e85 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.722719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe08c1-6c0c-424e-8b77-f9b76ad49e85 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.722990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe08c1-6c0c-424e-8b77-f9b76ad49e85 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.730127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 829/1657] 10.222.0.65 () {54 vars in 912 bytes} [Thu Dec 23 11:58:30 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:30.737651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.737992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.738257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.739634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8544f-7b6a-46a8-bdd2-057cb6e4d1bc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.746301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.747590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.748219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.749591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.766041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:30.768057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:30.776903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.781324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:30.813153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 829/1658] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:30 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:30.912462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.925957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdc37c-89b7-4395-bf90-8d57318d775c service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:30.930844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 830/1659] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:58:30 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:30.945819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:30.946495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:30.946808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:30.947082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:30.949132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:30.951043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:30.988023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:30.989485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.024041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 830/1660] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:30 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:58:31.096628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf8b0-de1b-4d4b-bbac-abfb7172c0dc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.104964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.106715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.107207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.107332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.148034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:31.155253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.160185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.182687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587934c-8044-4c02-b838-2bb54fd343de service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.193411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 831/1661] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:58:31.196759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:31.204148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.207283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.207807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.208280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.338038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.339745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.370429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 831/1662] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:31 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:31.390061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddc25b-027f-4612-9947-b6fa9e6a6600 service glance] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.395401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.397681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.398085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.398456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] PATH_INFO: `/v3/users/720a69bd1ef943fd940d02e4739d1e06` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.413778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=720a69bd1ef943fd940d02e4739d1e06)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.413778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: WARNING py.warnings [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:58:31.413778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: warnings.warn(msg) Dec 23 11:58:31.413778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: Dec 23 11:58:31.415715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:31.416860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.433379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b002f-b8d7-4597-b503-584e738dfe61 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.440647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.441700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.441986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.442353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] PATH_INFO: `/v3/users/536461eca51742caa717d537d24c3adb` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.446279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536461eca51742caa717d537d24c3adb)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.448515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.529701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536461eca51742caa717d537d24c3adb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.555266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536461eca51742caa717d537d24c3adb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.556687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536461eca51742caa717d537d24c3adb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.563956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720a69bd1ef943fd940d02e4739d1e06'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.575010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536461eca51742caa717d537d24c3adb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.590575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720a69bd1ef943fd940d02e4739d1e06'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.591515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720a69bd1ef943fd940d02e4739d1e06'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.598182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f42fd2e-784d-4749-a421-5b1053320c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536461eca51742caa717d537d24c3adb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.609424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 832/1663] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:31 2021] DELETE /identity/v3/users/536461eca51742caa717d537d24c3adb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:31.617464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.618732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.619280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.657850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720a69bd1ef943fd940d02e4739d1e06'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.658688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-af6a2f2e-7d7d-40e6-bd31-d463f0364e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720a69bd1ef943fd940d02e4739d1e06'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:31.661167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:31.662601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:31.680044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 832/1664] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:31 2021] DELETE /identity/v3/users/720a69bd1ef943fd940d02e4739d1e06 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:31.684080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67955a7-570b-408e-895d-659bca876bfd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.684592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67955a7-570b-408e-895d-659bca876bfd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.685023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67955a7-570b-408e-895d-659bca876bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.709848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a67955a7-570b-408e-895d-659bca876bfd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:31.711571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a67955a7-570b-408e-895d-659bca876bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:31.790190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 833/1665] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:31.810563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 833/1666] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:31.816263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67955a7-570b-408e-895d-659bca876bfd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:31.818348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a67955a7-570b-408e-895d-659bca876bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:31.837426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:31.839750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:31.940554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67955a7-570b-408e-895d-659bca876bfd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.946529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.947445 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.949525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.950336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.955945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81a9b9-d81d-42ae-a8ae-66344c777ae8 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:31.975915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.975915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8038e1-15c6-4f1b-9c29-a34ce663bbc0 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:31.976797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:31.976797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:31.976797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:31.976797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:31.983359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 834/1667] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:31.992971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:31.997971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87295560-18bb-4df8-9e76-0a57a433b62a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:32.013964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 834/1668] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:32.016144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:32.016674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:32.016800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:32.025016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 835/1669] 10.222.0.65 () {54 vars in 912 bytes} [Thu Dec 23 11:58:32 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:32.029536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:32.030292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:32.030491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:32.121761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:32.123082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:32.142319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 835/1670] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:58:32 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:32.171542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:32.175242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:32.200404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bbb05-8652-4385-8daa-f14640ea7db1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:32.204536 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:32.207037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:32.207364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:32.207590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:32.218004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:32.219372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637eb4f-937b-492d-ae2a-9ec3f717e587 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:32.233209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 836/1671] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:32.606071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:32.609083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:32.628618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7eea3-3618-4cc3-b39c-5f0233affad4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:32.646330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:32.648772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:32.650108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:32.650606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] PATH_INFO: `/v3/projects/3d63ec44670b46eabfde6472f6f6dc5e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:32.652094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d63ec44670b46eabfde6472f6f6dc5e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:32.657597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: WARNING py.warnings [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 23 11:58:32.657597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: warnings.warn(msg) Dec 23 11:58:32.657597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: Dec 23 11:58:32.660534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:32.804426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d63ec44670b46eabfde6472f6f6dc5e', 'request_id': 'req-b1b9c780-eda7-49ef-9afd-ee10b4587388'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:32.818939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d63ec44670b46eabfde6472f6f6dc5e', 'request_id': 'req-b1b9c780-eda7-49ef-9afd-ee10b4587388'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:32.834107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d63ec44670b46eabfde6472f6f6dc5e', 'request_id': 'req-b1b9c780-eda7-49ef-9afd-ee10b4587388'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:32.873381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] The token cache is being invalidate because project 3d63ec44670b46eabfde6472f6f6dc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:32.873760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:32.875579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:32.878250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 836/1672] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:32 2021] DELETE /identity/v3/projects/3d63ec44670b46eabfde6472f6f6dc5e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:32.883974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c157-4622-4345-aee4-ed0b17cc75b0 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:32.884564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c157-4622-4345-aee4-ed0b17cc75b0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:32.884564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c157-4622-4345-aee4-ed0b17cc75b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:32.912418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7810c157-4622-4345-aee4-ed0b17cc75b0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:32.913687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7810c157-4622-4345-aee4-ed0b17cc75b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:32.959655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:32.961430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.080645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 837/1673] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:33.088434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.088711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.089366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.136229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c780-eda7-49ef-9afd-ee10b4587388 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.145791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:33.150398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.151085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.151901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.152206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.152485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] PATH_INFO: `/v3/projects/041f7ef0362a483db89902d1d01979bc` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.155129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041f7ef0362a483db89902d1d01979bc)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.157203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.182175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 838/1674] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:33.183447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.204116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9fff1-8cd0-489b-b11f-a1cd47aa6de6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.219402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.221575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.222729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.224661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.225835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:33.226309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.229500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.264037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 839/1675] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:33.265851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.272723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041f7ef0362a483db89902d1d01979bc', 'request_id': 'req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.292716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041f7ef0362a483db89902d1d01979bc', 'request_id': 'req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.299663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041f7ef0362a483db89902d1d01979bc', 'request_id': 'req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.305282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612fe0-4c27-49b3-95e0-62452265c63b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.333483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] The token cache is being invalidate because project 041f7ef0362a483db89902d1d01979bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:33.333775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.335819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.342730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 837/1676] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:32 2021] DELETE /identity/v3/projects/041f7ef0362a483db89902d1d01979bc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:33.343807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.345299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.488479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.489181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.489463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.489736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.490457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.492515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.499392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206fab-6e06-4e0b-b1d4-b9a048a62d73 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.505424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.506999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.507285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.507704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] PATH_INFO: `/v3/users/78104233add8401d94cca634c3541b42` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.509986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78104233add8401d94cca634c3541b42)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.512427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.550611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 840/1677] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:33 2021] POST /identity/v3/projects => generated 369 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:33.554565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.561160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.621707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78104233add8401d94cca634c3541b42'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.641198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78104233add8401d94cca634c3541b42'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.642264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78104233add8401d94cca634c3541b42'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.665423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78104233add8401d94cca634c3541b42'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.682774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78104233add8401d94cca634c3541b42'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.691647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 838/1678] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:33 2021] DELETE /identity/v3/users/78104233add8401d94cca634c3541b42 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:33.692672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.706987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.746181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff5939-4280-4178-9c67-0a24822550e4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.793294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311317fc-e76c-44cc-be27-86e68974f226 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.799581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.800525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.801030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.801525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.811601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.827904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.829549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.852938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 839/1679] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:33.853900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:33.854031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.855004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.855283 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.855561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] PATH_INFO: `/v3/users/12956d4d1cfe49bcbb9a4c7bbe283dbd` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.857625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12956d4d1cfe49bcbb9a4c7bbe283dbd)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.858839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:33.859344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.889786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a619b-984f-4402-8587-0436d774468b service placement] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:33.899795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:33.900491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.900779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.901082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.903859 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:33.908317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9d352-0946-4f88-9cac-7ae3b4656edb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:33.977077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12956d4d1cfe49bcbb9a4c7bbe283dbd'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.986277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 840/1680] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:33 2021] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:33.989822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:33.991349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:33.992647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:33.993353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12956d4d1cfe49bcbb9a4c7bbe283dbd'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:33.994460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12956d4d1cfe49bcbb9a4c7bbe283dbd'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:34.024322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:34.025665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:34.026396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12956d4d1cfe49bcbb9a4c7bbe283dbd'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:34.027819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12956d4d1cfe49bcbb9a4c7bbe283dbd'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:34.035191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 841/1681] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:34.036942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.038901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:34.057401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47f50-4236-4b94-ae57-5874bf12437c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.063637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.065892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.066266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.066641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.068277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.071922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:34.082182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 841/1682] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:33 2021] DELETE /identity/v3/users/12956d4d1cfe49bcbb9a4c7bbe283dbd => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:34.096536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 842/1683] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:34.099115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.101022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:34.107576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.121845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f607e-a8cd-40a1-9fa2-a315db4473b8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.220556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.222070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.222577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.223091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.224131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.226208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:34.252721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ea6c-61b0-4343-a707-b751ddd143e3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.258296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 843/1684] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:34 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:34.264740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.274188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.274900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.275182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.275459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.287231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3abc0-94ee-461e-b056-98c91153dce7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.301819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.303009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.304788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.305059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.305994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] PATH_INFO: `/v3/projects/c8acf404324d455aa761e35356f73425/users/41b0b8aa68014be99611156d9bfd1686/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.306094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f866e-93b7-4570-a985-846ad6dd4645 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:34.330138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8acf404324d455aa761e35356f73425, user_id=41b0b8aa68014be99611156d9bfd1686, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.332996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 842/1685] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:34.333753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:34.376492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 844/1686] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:34 2021] PUT /identity/v3/projects/c8acf404324d455aa761e35356f73425/users/41b0b8aa68014be99611156d9bfd1686/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:34.433905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.434880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.435388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.498272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] MFA Rules not processed for user `41b0b8aa68014be99611156d9bfd1686`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:34.500917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:34.689248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 843/1687] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:34 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:34.694113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.783713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77af2-dd50-4251-9feb-e9e7c544b9a9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.794271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.795901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.796351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.797251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.798148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.800354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:34.854268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:34.865823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 845/1688] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:34 2021] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:34.870872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc082d5-10ad-41ad-93e3-518d9055401a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:34.969044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:34.969992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:34.970634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:34.971233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:34.972362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:34.975109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.009876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.017329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 844/1689] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:34 2021] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:35.025980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41e04-c368-496d-b10a-8d1c7fc2591f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.031812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.033791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.035844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.036515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.037469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.039442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.048620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.050681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.072648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7818-24f4-4ac7-9b22-95b3e0399f02 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.090296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.090631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 846/1690] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:35 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:58:35.091769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.092941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.093815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.094734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] PATH_INFO: `/v3/projects/062d8fbe4d034920a6f7654daff33d91` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.097376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=062d8fbe4d034920a6f7654daff33d91)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.102802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.115090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315038c3-b813-4b6f-8c8e-37e5927efb53 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.131893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.132811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.134849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.137313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] PATH_INFO: `/v3/projects/04527c3c09534933837a2972586a8190/users/beb37ecfd3bc44e5b3cf36756f9b2927/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.173849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04527c3c09534933837a2972586a8190, user_id=beb37ecfd3bc44e5b3cf36756f9b2927, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.177083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.208736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 847/1691] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:35 2021] PUT /identity/v3/projects/04527c3c09534933837a2972586a8190/users/beb37ecfd3bc44e5b3cf36756f9b2927/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:35.211583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.214705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.217632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062d8fbe4d034920a6f7654daff33d91', 'request_id': 'req-e07873fd-abc6-42ff-a195-23883787c25e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.236571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062d8fbe4d034920a6f7654daff33d91', 'request_id': 'req-e07873fd-abc6-42ff-a195-23883787c25e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.246471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062d8fbe4d034920a6f7654daff33d91', 'request_id': 'req-e07873fd-abc6-42ff-a195-23883787c25e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.273273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] The token cache is being invalidate because project 062d8fbe4d034920a6f7654daff33d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:35.275780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.277944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.288987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 845/1692] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:35 2021] DELETE /identity/v3/projects/062d8fbe4d034920a6f7654daff33d91 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:35.290138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.295470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.410415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e7eb2-02c9-4ef7-b04a-f0c1404eec3a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.417908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.418830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.419180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.419550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] PATH_INFO: `/v3/projects/645cdb6dacb842d596763f1cc0db0ea8` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.421991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=645cdb6dacb842d596763f1cc0db0ea8)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.423988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.442172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07873fd-abc6-42ff-a195-23883787c25e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.451764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.454442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.454845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.455126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.455894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.457519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdbce2-94aa-444e-9006-f059a5408a25 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.492149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 846/1693] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:35 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:35.498282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.498713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.499045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.532826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:35.533556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645cdb6dacb842d596763f1cc0db0ea8', 'request_id': 'req-6bbb0085-d253-4de3-924b-939b57f0f38e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.537435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.550620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645cdb6dacb842d596763f1cc0db0ea8', 'request_id': 'req-6bbb0085-d253-4de3-924b-939b57f0f38e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.558501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645cdb6dacb842d596763f1cc0db0ea8', 'request_id': 'req-6bbb0085-d253-4de3-924b-939b57f0f38e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.589551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] The token cache is being invalidate because project 645cdb6dacb842d596763f1cc0db0ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:35.590039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.591531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.593972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 848/1694] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:35 2021] DELETE /identity/v3/projects/645cdb6dacb842d596763f1cc0db0ea8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:35.597009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.598700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.688850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 847/1695] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:35.690448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.691695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.698123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0085-d253-4de3-924b-939b57f0f38e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.705943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35a3b1-1c08-433e-840c-ca15634e5a85 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.713235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.714142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.714369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:35.714532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.714701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] PATH_INFO: `/v3/projects/04527c3c09534933837a2972586a8190/users/beb37ecfd3bc44e5b3cf36756f9b2927/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.717646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.718038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.718416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] PATH_INFO: `/v3/users/7d38edeaac2a4d3da7603a2aaf4d6253` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.723116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d38edeaac2a4d3da7603a2aaf4d6253)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.725500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.727440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04527c3c09534933837a2972586a8190, user_id=beb37ecfd3bc44e5b3cf36756f9b2927, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:35.730106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f576776-3408-45cf-b90f-6544ef0c2928 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:35.749332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 849/1696] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:35 2021] PUT /identity/v3/projects/04527c3c09534933837a2972586a8190/users/beb37ecfd3bc44e5b3cf36756f9b2927/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:35.750853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.751137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.751408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.792728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:35.794438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:35.844809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d38edeaac2a4d3da7603a2aaf4d6253'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.859361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d38edeaac2a4d3da7603a2aaf4d6253'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.860760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d38edeaac2a4d3da7603a2aaf4d6253'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.883900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d38edeaac2a4d3da7603a2aaf4d6253'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.885533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e68d507f-57bd-4830-a5e4-0a2efc5d5f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d38edeaac2a4d3da7603a2aaf4d6253'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:35.906737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 848/1697] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:35 2021] DELETE /identity/v3/users/7d38edeaac2a4d3da7603a2aaf4d6253 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:35.908208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:35.908653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:35.908953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:35.913203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 850/1698] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:35.920653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:35.944876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acf779-39d2-48fd-87bc-838d47125744 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:35.949337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] MFA Rules not processed for user `beb37ecfd3bc44e5b3cf36756f9b2927`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:35.950772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:36.098030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.098693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.098976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.099247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.099996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:36.102837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.106236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.132587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 851/1699] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:36.137270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.158277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceb60d-14ea-45ac-bbad-b52a8f2502cd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.170119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.171289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.172142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.173842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.176130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.181320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.182066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 849/1700] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:35 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:36.196307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.198059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:36.242075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 852/1701] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:36 2021] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:36.246011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.351936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115dbf-e0b1-4f40-a8a8-717d3b393906 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.421185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d329-6617-4e51-b9e9-df5f1f8bdaa0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.432624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.433690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.433829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.434169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.435130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.440232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.477236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.477916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.478195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.478469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.494610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 853/1702] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:36 2021] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:36.550130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.568131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52020050-1769-4310-b538-f0a3a500ce16 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.584489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.587802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.590263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.591709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.594835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.599710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.628378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 854/1703] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:36 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:58:36.634177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.643980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.645446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.648826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e213-1672-4b6a-8b2d-f512e3addc99 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.655837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.656854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.657349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.657956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.658906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.659124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 850/1704] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:36 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:58:36.666613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600ff7-4cfc-48d0-b48e-fcac902e2b58 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.684597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 855/1705] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:36 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:36.688557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:36.705294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4194-eebd-4ffd-91b0-534061447b95 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:36.715206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:36.716340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.716507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.716786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] PATH_INFO: `/v3/projects/4a354843673a406ea714281db0adbaf1/users/c24d5ed65b8842dea77c231af3f53ee5/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.759094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a354843673a406ea714281db0adbaf1, user_id=c24d5ed65b8842dea77c231af3f53ee5, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:36.769278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:36.815752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 851/1706] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:36 2021] PUT /identity/v3/projects/4a354843673a406ea714281db0adbaf1/users/c24d5ed65b8842dea77c231af3f53ee5/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:36.836036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:36.836724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:36.836724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:36.929991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] MFA Rules not processed for user `c24d5ed65b8842dea77c231af3f53ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:36.932416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:37.102112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 856/1707] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:37.106094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:37.349945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0084f-4abe-44ae-bf3a-afc8b9e9c440 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:37.367565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:37.367967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:37.368117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:37.368546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:37.369646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:37.371818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:37.386293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:37.388408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:37.459188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f81c9-ba76-48aa-8ad4-6abe99bfe5f0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:37.466835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 852/1708] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:37 2021] POST /identity/v3/projects => generated 381 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:37.480912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:37.488060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:37.488949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:37.489224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:37.489495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] PATH_INFO: `/v3/projects/19b13514c9b44575973e62fbf323d399` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:37.505169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b13514c9b44575973e62fbf323d399)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:37.517461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:37.684975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b13514c9b44575973e62fbf323d399', 'request_id': 'req-2b6e848a-0853-471b-a09f-886ea7914047'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:37.701059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b13514c9b44575973e62fbf323d399', 'request_id': 'req-2b6e848a-0853-471b-a09f-886ea7914047'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:37.714114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b13514c9b44575973e62fbf323d399', 'request_id': 'req-2b6e848a-0853-471b-a09f-886ea7914047'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:37.747221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] The token cache is being invalidate because project 19b13514c9b44575973e62fbf323d399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:37.748664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:37.749935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b6e848a-0853-471b-a09f-886ea7914047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:37.755077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 857/1709] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:37 2021] DELETE /identity/v3/projects/19b13514c9b44575973e62fbf323d399 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:37.761569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a6f4-9abb-4d00-bbc7-cce7587944ae None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:37.761897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a6f4-9abb-4d00-bbc7-cce7587944ae None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:37.762257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a6f4-9abb-4d00-bbc7-cce7587944ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:37.788785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b905f3-7989-4be9-bee6-917fe76e43d2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:37.799625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f7c5a6f4-9abb-4d00-bbc7-cce7587944ae None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:37.801904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f7c5a6f4-9abb-4d00-bbc7-cce7587944ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:37.994937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:37.997934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:37.998421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:37.998980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.000947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.005881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.007220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 858/1710] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:38.075370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 853/1711] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:37 2021] POST /identity/v3/users => generated 297 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:38.077470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.077831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.078085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.081645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.088420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:38.134839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa93ca3-14fb-4037-957c-4ad9947f3321 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.139748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:38.141368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:38.154117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.155004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.155289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.156587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.157377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.169503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.177141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 859/1712] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:38.182761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.202062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 854/1713] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:38.208626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.212122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a8239-f127-48ee-9026-f0a06c38fbf0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.255304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.256002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.256289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.256546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.257306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:38.257620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.257740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6354da-f2ad-4df3-9fc5-e14d8e628ce2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.259297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.278377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.279520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.280003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.308218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] PATH_INFO: `/v3/projects/05302d7328a345e8881186fa48aa296a/users/ffc5fbcac63b43c8a79e0c284fc3fece/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.343174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05302d7328a345e8881186fa48aa296a, user_id=ffc5fbcac63b43c8a79e0c284fc3fece, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.344100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 860/1714] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:38.345967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.348504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.401945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fe978-35fa-4e67-8f12-44d54f71348f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.404642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 855/1715] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:38 2021] PUT /identity/v3/projects/05302d7328a345e8881186fa48aa296a/users/ffc5fbcac63b43c8a79e0c284fc3fece/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:38.408971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.649380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.650071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.650349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.650648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.651367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.660410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f98b25-33bd-482e-88b4-92fc1856e48f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.673086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.684298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.686586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.686892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.687173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.687937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.689572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.728431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 856/1716] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:38 2021] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:38.732500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.755160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 861/1717] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:38 2021] POST /identity/v3/projects => generated 371 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:38.755314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab5d2-d752-4ede-9776-3be17059332f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.757293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:38.945315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047b664-2c59-4696-9604-1284e20c8f24 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:38.953941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.955023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.955446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.955852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.956846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.961095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6f82-e746-4a4d-a203-c06f024c2457 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:38.972187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:38.973136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:38.973422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:38.973848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] PATH_INFO: `/v3/projects/05302d7328a345e8881186fa48aa296a/users/ffc5fbcac63b43c8a79e0c284fc3fece/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:38.976340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05302d7328a345e8881186fa48aa296a, user_id=ffc5fbcac63b43c8a79e0c284fc3fece, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:38.983240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:39.032032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 862/1718] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:38 2021] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:39.037181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 857/1719] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:38 2021] PUT /identity/v3/projects/05302d7328a345e8881186fa48aa296a/users/ffc5fbcac63b43c8a79e0c284fc3fece/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:39.038422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:39.047624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.047929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.048961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.135338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] MFA Rules not processed for user `804530daa2704fcdb1fef91615b62c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:39.136579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:39.237096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d7b2-8252-4ef3-81bb-2f5c069a0707 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:39.281637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:39.282379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.282705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.282998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.283775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:39.301167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dfe01-e385-4a75-aaee-b62dd36f7ac3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:39.335094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 858/1720] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:39 2021] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:39.336784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.337316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.337792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.392982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 863/1721] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:39 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:39.394837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:39.435794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] MFA Rules not processed for user `ffc5fbcac63b43c8a79e0c284fc3fece`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:39.437249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:39.450695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248399-46a3-4a50-bcb2-dc70fa91216c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:39.472457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:39.473321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.473604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.473872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.474655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:39.476429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c6ce0-41a6-4173-867b-35288b073c02 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:39.535409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 864/1722] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:39 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:39.546034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.546671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.547135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.633034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 859/1723] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:39 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:39.634013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:39.644910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:39.649881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:39.652404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:39.805735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 865/1724] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:58:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:39.808787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:39.823916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18a48-153e-4367-9ee8-d4746ff73da1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:39.833939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:39.835138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.835528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.835801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] PATH_INFO: `/v3/projects/5aed4f67c194464493a41cb6b23656bb/users/f7e5bab7438d43c987bdfd25776171bc/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.839798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82b864-2a7b-4ac9-b435-a3876a8ad77c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:39.859315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aed4f67c194464493a41cb6b23656bb, user_id=f7e5bab7438d43c987bdfd25776171bc, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:39.861366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:39.862431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.862932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.863282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.863724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae884c4d-2b16-481a-8fe7-b69373d18937 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:39.887047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:39.889110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:39.905353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 866/1725] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:39 2021] PUT /identity/v3/projects/5aed4f67c194464493a41cb6b23656bb/users/f7e5bab7438d43c987bdfd25776171bc/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:39.908373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770aff-511d-42e1-ac68-54535a056983 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:39.915007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770aff-511d-42e1-ac68-54535a056983 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:39.915473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f770aff-511d-42e1-ac68-54535a056983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:39.921078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 860/1726] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:39 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:39.922116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:39.927412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:39.994041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9f770aff-511d-42e1-ac68-54535a056983 None None] MFA Rules not processed for user `3f41f3bd3c1142aca50069a45a26aaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:39.996136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9f770aff-511d-42e1-ac68-54535a056983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.052477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec3ded-8bd8-4b56-8aa2-c5e4b46dae2d service nova] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:40.132046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:40.132725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.133007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.133280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.135790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 867/1727] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:40.137347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.138325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.138638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.191821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] MFA Rules not processed for user `f7e5bab7438d43c987bdfd25776171bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:40.193036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.288007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:40.289691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d04df5-7457-4e73-ad0b-d399355ee4ee service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:40.319947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 861/1728] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:39 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:40.322053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.322053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.322053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.376281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] MFA Rules not processed for user `3f41f3bd3c1142aca50069a45a26aaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:40.377696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.378095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 868/1729] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:40.379153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:40.380914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.397739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 862/1730] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:40.409016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:40.560276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfe6d4-22c7-4816-af14-bdae02d06101 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:40.562649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e282-f7d7-4571-911c-033351ab310d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:40.572442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:40.573164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.573420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:40.573529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.573782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.574101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.574413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.574684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.575678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:40.577933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:40.661592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 863/1731] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:40 2021] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:40.663066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:40.665124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.669929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:40.675656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:40.698434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 869/1732] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 11:58:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 11:58:40.699187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:40.703636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.809730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317ab8c-2068-4ef6-a87d-c17ccc599530 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:40.846235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:40.847108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:40.847265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:40.847546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:40.863016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:40.878053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62a91-94ee-4a93-a18a-b9ad685ccaa8 service swift] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:41.029754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:41.030797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:41.031122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:41.031480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:41.095490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:41.097680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:41.126111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 864/1733] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:40 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:41.127243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:41.277127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:41.280351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:41.304278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 870/1734] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:40 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:41.309057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:41.312556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:41.385730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff437b3-c4a3-40bb-9af8-d168ffb13398 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:41.406571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:41.408397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:41.414161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:41.414868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:41.416320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:41.419873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:41.501476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 865/1735] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:41 2021] POST /identity/v3/users => generated 293 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:41.501476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:41.508564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:41.525839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787211f3-a7c9-445d-b6cb-424fd0ad1e49 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:41.548585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:41.549874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:41.550219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:41.550497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] PATH_INFO: `/v3/users/2fd5fa3d5f0545329f8ae695b74aadcc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:41.551944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd5fa3d5f0545329f8ae695b74aadcc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:41.554318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:41.587305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff9ed5-ce5e-4b75-9fa3-0950645cb53d service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:41.631583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:41.632651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:41.632973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:41.633249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] PATH_INFO: `/v3/users/41b0b8aa68014be99611156d9bfd1686` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:41.637557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b0b8aa68014be99611156d9bfd1686)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:41.647252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:41.740779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd5fa3d5f0545329f8ae695b74aadcc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.775825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd5fa3d5f0545329f8ae695b74aadcc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.784008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd5fa3d5f0545329f8ae695b74aadcc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.844164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b0b8aa68014be99611156d9bfd1686'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.849151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd5fa3d5f0545329f8ae695b74aadcc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.850496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce9907b3-47e1-4af1-a5eb-9d375253448e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd5fa3d5f0545329f8ae695b74aadcc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.865434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b0b8aa68014be99611156d9bfd1686'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.866763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b0b8aa68014be99611156d9bfd1686'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.892725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 866/1736] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:41 2021] DELETE /identity/v3/users/2fd5fa3d5f0545329f8ae695b74aadcc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:41.894353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec32-b52d-4363-9c4a-60cef4fef6a3 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:41.894763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec32-b52d-4363-9c4a-60cef4fef6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:41.896044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec32-b52d-4363-9c4a-60cef4fef6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:41.900631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b0b8aa68014be99611156d9bfd1686'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.955079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2bd8ec32-b52d-4363-9c4a-60cef4fef6a3 None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:41.957146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b0b8aa68014be99611156d9bfd1686'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:41.958892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2bd8ec32-b52d-4363-9c4a-60cef4fef6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:41.974984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 871/1737] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:41 2021] DELETE /identity/v3/users/41b0b8aa68014be99611156d9bfd1686 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:41.977337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:41.981920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.092886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 867/1738] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Dec 23 11:58:41 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:42.095363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.095697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.096618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.149293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:42.151052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.265188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6ac2-2e47-479f-9876-7fe872e55264 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:42.286203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:42.289569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 868/1739] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:42.289769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.291003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:42.291789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.292250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.293279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.296556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:42.300540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933be67-d7b5-4194-a3e2-e05d4439c94e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:42.329474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7539a-bab7-431e-b62b-9885d1abfa09 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:42.348649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 872/1740] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:41 2021] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:42.350837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.351331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.351672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.353856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:42.363499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.364080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.364547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] PATH_INFO: `/v3/users/c24d5ed65b8842dea77c231af3f53ee5` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.372461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24d5ed65b8842dea77c231af3f53ee5)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:42.383635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:42.452797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:42.454631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.495188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 873/1741] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:42.496327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:42.498095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.555144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24d5ed65b8842dea77c231af3f53ee5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:42.577933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24d5ed65b8842dea77c231af3f53ee5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:42.580830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24d5ed65b8842dea77c231af3f53ee5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:42.617264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24d5ed65b8842dea77c231af3f53ee5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:42.618473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24d5ed65b8842dea77c231af3f53ee5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:42.664772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 869/1742] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:42 2021] DELETE /identity/v3/users/c24d5ed65b8842dea77c231af3f53ee5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:42.666114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:42.668657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.697124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8c8c-54e4-4768-8ef4-cad7f1db1039 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:42.811233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:42.811906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.812231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.812522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.820198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.841802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:42.845453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:42.872749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13f474-8030-417e-92b8-210798a0f93f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:42.875217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 874/1743] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:42.876094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:42.882055 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:42.882808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:42.883125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:42.883477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:42.883579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:42.887541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.020015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:43.021521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:43.046449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 870/1744] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:43.047448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:43.051582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.077745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf0f1a-e2af-4a58-b1fe-9ca32642f546 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:43.087827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:43.088260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.088786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.088906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d978cf-7abe-41f7-8f54-2063564c846c service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:43.088991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.092744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.101533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:43.102554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.102884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.112663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] PATH_INFO: `/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb/users/6a62ccfef2cd4747b0cd948078e78c70/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.120904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:43.124211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e62d2b-6c8b-429a-be1b-25ad2149ae25 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:43.149850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 871/1745] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:43.153423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ded02-3b55-4010-afbf-9464d332d756 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.153835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ded02-3b55-4010-afbf-9464d332d756 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.154446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ded02-3b55-4010-afbf-9464d332d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.166316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7dc3865ca9437ebfe2cd58507e6ceb, user_id=6a62ccfef2cd4747b0cd948078e78c70, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:43.172386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853825-826b-48ac-a21b-4c1518ed30ad admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:43.202985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9f0ded02-3b55-4010-afbf-9464d332d756 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:43.211048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9f0ded02-3b55-4010-afbf-9464d332d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.220767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 875/1746] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:42 2021] PUT /identity/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb/users/6a62ccfef2cd4747b0cd948078e78c70/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:43.222418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89104a8-ca23-447e-a0ca-3c491f968105 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.222768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89104a8-ca23-447e-a0ca-3c491f968105 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.223106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89104a8-ca23-447e-a0ca-3c491f968105 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.231125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 876/1747] 10.222.0.65 () {54 vars in 912 bytes} [Thu Dec 23 11:58:43 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:43.232034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89104a8-ca23-447e-a0ca-3c491f968105 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:43.387723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 872/1748] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:43.392412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.392939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.393413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.432060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89104a8-ca23-447e-a0ca-3c491f968105 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:43.437236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:43.441159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.442465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:43.443365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.443958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.443958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.444817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:43.448723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:43.487063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 877/1749] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:43 2021] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:43.488321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:43.581635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 873/1750] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 11:58:43 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:43.582492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:43.594376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb23efe-b448-4e8c-b92c-9127c9457877 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:43.599621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:43.600534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.600855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.601125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] PATH_INFO: `/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb/users/6a62ccfef2cd4747b0cd948078e78c70/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.603339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7dc3865ca9437ebfe2cd58507e6ceb, user_id=6a62ccfef2cd4747b0cd948078e78c70, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:43.606219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931849c0-45a7-46d6-bb51-5cd5cefc1bca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:43.626952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 874/1751] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:43 2021] PUT /identity/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb/users/6a62ccfef2cd4747b0cd948078e78c70/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:43.628966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.629254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.629528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.720969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] MFA Rules not processed for user `6a62ccfef2cd4747b0cd948078e78c70`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:43.723088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af24fd-0ab5-4355-bbba-c28ce231108a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:43.727821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:43.929864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:43.932958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:43.933787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:43.935843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:43.977264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 875/1752] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:43 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:43.978304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:44.031333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb92cef-b62e-4414-a154-55d141b45873 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:44.045835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:44.047656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:44.048088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:44.050438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:44.078456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:44.080665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:44.109421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 876/1753] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:44.110491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:44.127080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:44.172877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:44.174591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:44.201890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 878/1754] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:44.203966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:44.209494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:44.237910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539898a-99af-48e8-b06c-a050d3b5f9b9 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:44.255595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:44.256501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:44.256790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:44.257053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] PATH_INFO: `/v3/users/f46a8ad111c54e158adcb2745f832cac` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:44.260554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46a8ad111c54e158adcb2745f832cac)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:44.263582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:44.318040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cc491-d7c4-472e-aec6-84f651b4ab25 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:44.329014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:44.329960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:44.330395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:44.333078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:44.369892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:44.372937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be49024-dbd8-414e-b6df-4244aee14eb2 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:44.375747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46a8ad111c54e158adcb2745f832cac'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:44.392606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46a8ad111c54e158adcb2745f832cac'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:44.393782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46a8ad111c54e158adcb2745f832cac'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:44.401104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 877/1755] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:44 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:44.413463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46a8ad111c54e158adcb2745f832cac'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:44.459781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46a8ad111c54e158adcb2745f832cac'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:44.500858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 879/1756] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:44 2021] DELETE /identity/v3/users/f46a8ad111c54e158adcb2745f832cac => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:44.506477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:44.506935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:44.507263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:44.557279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:44.562412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:44.663473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 878/1757] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:44.707425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:44.708871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:44.989554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:44.991707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.010231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76947dfa-a76c-4862-bda6-e372e2a46afe admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:45.044077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde1ef4-4576-4b20-89e5-b7f7b10670a5 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:45.054396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:45.056547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:45.057760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.057760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.057989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] PATH_INFO: `/v3/users/f7e5bab7438d43c987bdfd25776171bc` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.060323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e5bab7438d43c987bdfd25776171bc)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:45.062059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.062366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.062777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.065954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:45.135189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:45.154284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:45.242178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 880/1758] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:45.245199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:45.260391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.260799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e5bab7438d43c987bdfd25776171bc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.272629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e5bab7438d43c987bdfd25776171bc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.273528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e5bab7438d43c987bdfd25776171bc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.305313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e5bab7438d43c987bdfd25776171bc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.306320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ee05b2ee-0124-4ca0-a251-1cde134f13d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e5bab7438d43c987bdfd25776171bc'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.317336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2a09-3c60-485c-90a3-634ffadc77b7 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:45.343847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 879/1759] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:44 2021] DELETE /identity/v3/users/f7e5bab7438d43c987bdfd25776171bc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:45.344813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:45.352808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.354063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51f17-dd88-4188-b8f6-27bfc1228ad4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.354864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51f17-dd88-4188-b8f6-27bfc1228ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.357859 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51f17-dd88-4188-b8f6-27bfc1228ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.358473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.358821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] PATH_INFO: `/v3/projects/5887f7f050514497b85cd77003ea7a8e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.366642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5887f7f050514497b85cd77003ea7a8e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:45.371816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:45.394256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f7d51f17-dd88-4188-b8f6-27bfc1228ad4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:45.396553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f7d51f17-dd88-4188-b8f6-27bfc1228ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.528546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 880/1760] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:45.530843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c5f94-1e74-4e05-8bae-f707ef982666 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.531220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c5f94-1e74-4e05-8bae-f707ef982666 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.531680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c5f94-1e74-4e05-8bae-f707ef982666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.593261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5887f7f050514497b85cd77003ea7a8e', 'request_id': 'req-43e05b72-82db-47cf-84ce-11e474da1226'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.599690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cd4c5f94-1e74-4e05-8bae-f707ef982666 None None] MFA Rules not processed for user `3f41f3bd3c1142aca50069a45a26aaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:45.602221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cd4c5f94-1e74-4e05-8bae-f707ef982666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.608438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5887f7f050514497b85cd77003ea7a8e', 'request_id': 'req-43e05b72-82db-47cf-84ce-11e474da1226'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.643681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5887f7f050514497b85cd77003ea7a8e', 'request_id': 'req-43e05b72-82db-47cf-84ce-11e474da1226'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.692979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] The token cache is being invalidate because project 5887f7f050514497b85cd77003ea7a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:45.693271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.695697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:45.714313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 881/1761] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:45 2021] DELETE /identity/v3/projects/5887f7f050514497b85cd77003ea7a8e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:45.714313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:45.715758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.747795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 881/1762] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:45 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:45.750658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.750968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.751247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.802810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:45.808215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:45.945855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05b72-82db-47cf-84ce-11e474da1226 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:45.970032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:45.971962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:45.972254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:45.973731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:45.994733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:46.135185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 882/1763] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:46.135185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:46.137534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:46.176047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d8333-e5e1-4b90-a04c-684015e68cc2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:46.199466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:46.205824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.206177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.206345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] PATH_INFO: `/v3/projects/c8acf404324d455aa761e35356f73425` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:46.223358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8acf404324d455aa761e35356f73425)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:46.229932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:46.279295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:46.287295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab93f7-d4ca-4bf2-998d-d44188b65860 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:46.317610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 882/1764] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:46.328096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.329578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.329866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:46.364660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8acf404324d455aa761e35356f73425', 'request_id': 'req-3754ad80-27c3-4c10-a17e-feb5507bba79'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.381470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8acf404324d455aa761e35356f73425', 'request_id': 'req-3754ad80-27c3-4c10-a17e-feb5507bba79'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.385938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:46.391727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:46.398701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8acf404324d455aa761e35356f73425', 'request_id': 'req-3754ad80-27c3-4c10-a17e-feb5507bba79'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.432525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] The token cache is being invalidate because project c8acf404324d455aa761e35356f73425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:46.432851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.441619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.443463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 883/1765] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:46 2021] DELETE /identity/v3/projects/c8acf404324d455aa761e35356f73425 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:46.447935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:46.451914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:46.588455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 883/1766] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:46.593679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:46.618155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278caea4-7bdd-4b3a-ae2a-429d4a2961c3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:46.632424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:46.633571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.633837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.634782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:46.635464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:46.638652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:46.642542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:46.645928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754ad80-27c3-4c10-a17e-feb5507bba79 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:46.661471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:46.662378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.662694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.662958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] PATH_INFO: `/v3/users/beb37ecfd3bc44e5b3cf36756f9b2927` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:46.667413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb37ecfd3bc44e5b3cf36756f9b2927)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:46.670226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:46.689447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 884/1767] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:46.690767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:46.728723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047659-c2e1-4513-bb24-9eb7e627cc20 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:46.751928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:46.754107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.756632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.758232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:46.758232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:46.767841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:46.793113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb37ecfd3bc44e5b3cf36756f9b2927'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.824528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 885/1768] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:46 2021] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:46.831466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:46.837806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb37ecfd3bc44e5b3cf36756f9b2927'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.839194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb37ecfd3bc44e5b3cf36756f9b2927'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.892901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb37ecfd3bc44e5b3cf36756f9b2927'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.896384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3cc1f63f-9576-4114-9d45-4fb37e9efd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb37ecfd3bc44e5b3cf36756f9b2927'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:46.943535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 884/1769] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:46 2021] DELETE /identity/v3/users/beb37ecfd3bc44e5b3cf36756f9b2927 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:46.991232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:46.991634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:46.992416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.062028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] MFA Rules not processed for user `804530daa2704fcdb1fef91615b62c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:47.065624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.072794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ca8-b300-40fb-b7eb-74cb39af9b0a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.273204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 885/1770] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:46 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:47.277630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.278738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.279135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.279640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.280360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.289022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.322770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:47.329375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.362625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27f39-f47f-4dd9-b0e3-8d688b8cdbea None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.368938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.369839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.370185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.370623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] PATH_INFO: `/v3/projects/674458dc864c496db9e2732be043b1e3` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.372387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=674458dc864c496db9e2732be043b1e3)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.381366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.381568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 886/1771] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:46 2021] POST /identity/v3/users => generated 302 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:47.382864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:47.398543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.433208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2694-977c-4901-b4c6-6e7e2924b40d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.439841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.445863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.446683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.450224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.452152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.455045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.484217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674458dc864c496db9e2732be043b1e3', 'request_id': 'req-19cb9372-aab0-44c8-a64a-b24eda49d58a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.492947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 887/1772] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:47 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:47.495098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:47.510601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674458dc864c496db9e2732be043b1e3', 'request_id': 'req-19cb9372-aab0-44c8-a64a-b24eda49d58a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.535267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87ec2-b6dd-48ef-b453-42d5df877a37 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.536621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674458dc864c496db9e2732be043b1e3', 'request_id': 'req-19cb9372-aab0-44c8-a64a-b24eda49d58a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.561227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] The token cache is being invalidate because project 674458dc864c496db9e2732be043b1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:47.561531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.562378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-19cb9372-aab0-44c8-a64a-b24eda49d58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.572835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 886/1773] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:47 2021] DELETE /identity/v3/projects/674458dc864c496db9e2732be043b1e3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:47.582374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.585310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.585631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.639352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:47.646607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.724868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.726809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.727108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.728106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.731308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.744169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.778636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 888/1774] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:47 2021] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:47.779678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:47.790711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.813543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20c135-6f02-4e48-a5fd-07948d9ed0e1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.825180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.826823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.827127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.828281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] PATH_INFO: `/v3/projects/04527c3c09534933837a2972586a8190` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.831339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04527c3c09534933837a2972586a8190)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.837085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.839219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 887/1775] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:47.847747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:47.847747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:47.866899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a058b67-7003-4cbf-bf26-764b94b1586d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:47.884252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:47.885107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.885435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.885711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] PATH_INFO: `/v3/projects/686d4514ada0450fadf28cbc8fda9703/users/cf41c7302e554aec800fd923d12c77b4/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:47.919645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=686d4514ada0450fadf28cbc8fda9703, user_id=cf41c7302e554aec800fd923d12c77b4, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:47.922637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ee625-6c2a-459e-8487-8c29663e92bc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:47.937138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04527c3c09534933837a2972586a8190', 'request_id': 'req-454ce450-c86d-41cd-92ef-1774898fa582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.950482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04527c3c09534933837a2972586a8190', 'request_id': 'req-454ce450-c86d-41cd-92ef-1774898fa582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:47.966473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 888/1776] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:47 2021] PUT /identity/v3/projects/686d4514ada0450fadf28cbc8fda9703/users/cf41c7302e554aec800fd923d12c77b4/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:47.968220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306be17-c733-4ca3-bdc0-b4ab71e3b5d7 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:47.968619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306be17-c733-4ca3-bdc0-b4ab71e3b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:47.968822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306be17-c733-4ca3-bdc0-b4ab71e3b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.009424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b306be17-c733-4ca3-bdc0-b4ab71e3b5d7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:48.011028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b306be17-c733-4ca3-bdc0-b4ab71e3b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.030965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04527c3c09534933837a2972586a8190', 'request_id': 'req-454ce450-c86d-41cd-92ef-1774898fa582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.080464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] The token cache is being invalidate because project 04527c3c09534933837a2972586a8190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:48.090913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.092041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-454ce450-c86d-41cd-92ef-1774898fa582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.099740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 889/1777] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:47 2021] DELETE /identity/v3/projects/04527c3c09534933837a2972586a8190 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:48.102220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.102682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.103180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.147509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:48.152676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.155630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 889/1778] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:48.157327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a739f-e792-4129-9269-ff0804f09303 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.157783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a739f-e792-4129-9269-ff0804f09303 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.158209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a739f-e792-4129-9269-ff0804f09303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.186635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 890/1779] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:48.186635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.187443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-862a739f-e792-4129-9269-ff0804f09303 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:48.188812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-862a739f-e792-4129-9269-ff0804f09303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.205240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0747f9-1c7f-4a3b-8b1c-fe2b6a56a024 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.220801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.221633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.222267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 890/1780] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:48.222388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.223037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a739f-e792-4129-9269-ff0804f09303 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.229206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.230259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:48.230721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.233601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-862a739f-e792-4129-9269-ff0804f09303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.236587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dbb11-725a-4d3a-8ed0-6beaa5e7c06b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.266374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 891/1781] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:48.267811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.269493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.269909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.312687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:48.314077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.331770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 892/1782] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:48.335848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.349407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254c00-1da1-4202-b405-02cfac0c9b36 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.366537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.368472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.369791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.370177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.373024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.377598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.405660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a739f-e792-4129-9269-ff0804f09303 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.415494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.416973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.419013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.419433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.441504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 893/1783] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:48.442739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.443393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.446013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.479478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 891/1784] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:48.480119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.499903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67db557-42c8-4e67-9c8b-7009ef4a6263 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.577000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa97d-9563-45b2-a06e-c5156b3584f5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.591965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.593023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.593614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.594473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.600117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:48.603373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.607103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.612077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.613034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.613468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.613880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.614815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.617048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.648340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 894/1785] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:48.651452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.656371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.671802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 892/1786] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:48.672489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.678071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.703142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e90c-59c9-41c6-abb6-61593ea1d054 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.703368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d726d8a-a853-4518-a23c-7c5a295163b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:48.716449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.718040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.718198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.719057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:48.719756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] PATH_INFO: `/v3/projects/4a354843673a406ea714281db0adbaf1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.720004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:48.720286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:48.720611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] PATH_INFO: `/v3/projects/5aed4f67c194464493a41cb6b23656bb` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:48.722365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aed4f67c194464493a41cb6b23656bb)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.724108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a354843673a406ea714281db0adbaf1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:48.724361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.736438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:48.832829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aed4f67c194464493a41cb6b23656bb', 'request_id': 'req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.849269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aed4f67c194464493a41cb6b23656bb', 'request_id': 'req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.858247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a354843673a406ea714281db0adbaf1', 'request_id': 'req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.858832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aed4f67c194464493a41cb6b23656bb', 'request_id': 'req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.876927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a354843673a406ea714281db0adbaf1', 'request_id': 'req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.888637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a354843673a406ea714281db0adbaf1', 'request_id': 'req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.889611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] The token cache is being invalidate because project 5aed4f67c194464493a41cb6b23656bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:48.889967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.892421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.897581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 893/1787] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:48 2021] DELETE /identity/v3/projects/5aed4f67c194464493a41cb6b23656bb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:48.900243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.906402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:48.927766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] The token cache is being invalidate because project 4a354843673a406ea714281db0adbaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:48.938555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.940876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:48.950402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 895/1788] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:48 2021] DELETE /identity/v3/projects/4a354843673a406ea714281db0adbaf1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:48.951720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:48.957903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:49.190301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bea39-dfaa-4343-bc0b-e8582fe1727e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:49.239274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b0fd-e469-4606-9822-b6d5bfdeedfe admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:49.271085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:49.271779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.272064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.272336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.273095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:49.274772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadd027-d860-40b7-950b-990ac7eac624 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:49.312998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 896/1789] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:48 2021] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:49.316517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f884-ef30-407f-983b-b187253557f9 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.322061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f884-ef30-407f-983b-b187253557f9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.322603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f884-ef30-407f-983b-b187253557f9 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.328006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 897/1790] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:58:49 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:58:49.332159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f884-ef30-407f-983b-b187253557f9 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:49.338869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d087f884-ef30-407f-983b-b187253557f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:49.373778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f884-ef30-407f-983b-b187253557f9 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:49.376164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:49.377043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.377477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.378352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.380392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:49.383313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:49.391474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:49.393045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.393666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.394341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] PATH_INFO: `/v3/users/6a62ccfef2cd4747b0cd948078e78c70` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.398136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a62ccfef2cd4747b0cd948078e78c70)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:49.405740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:49.436897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 894/1791] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:48 2021] POST /identity/v3/projects => generated 385 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:49.438461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:49.446487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:49.524456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a62ccfef2cd4747b0cd948078e78c70'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.530197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c463a-ee98-4367-95ef-697b3349adab admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:49.532638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a62ccfef2cd4747b0cd948078e78c70'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.533507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a62ccfef2cd4747b0cd948078e78c70'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.542054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:49.544964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.545436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a62ccfef2cd4747b0cd948078e78c70'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.546464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.547019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] PATH_INFO: `/v3/users/ffc5fbcac63b43c8a79e0c284fc3fece` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.548773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc5fbcac63b43c8a79e0c284fc3fece)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:49.551631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:49.580356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a62ccfef2cd4747b0cd948078e78c70'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.591486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 898/1792] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:49 2021] DELETE /identity/v3/users/6a62ccfef2cd4747b0cd948078e78c70 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:49.592454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:49.593954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:49.660674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc5fbcac63b43c8a79e0c284fc3fece'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.669607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc5fbcac63b43c8a79e0c284fc3fece'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.670496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc5fbcac63b43c8a79e0c284fc3fece'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.715076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc5fbcac63b43c8a79e0c284fc3fece'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.716703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc5fbcac63b43c8a79e0c284fc3fece'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:49.746547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 895/1793] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:49 2021] DELETE /identity/v3/users/ffc5fbcac63b43c8a79e0c284fc3fece => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:49.747263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:49.759450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:49.769478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f99c4a-2dc8-463b-9501-92a4e67c250b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:49.944483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:49.945448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.945877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.946295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:49.947232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:49.949229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f37e-f6e3-43cb-8d9c-6c564b642abf admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:49.982969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 899/1794] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:49.984725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:49.990153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:49.990806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.009142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46edf-f146-41c8-83a5-3f12f13b4e3b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.027351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.027897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.028240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.028517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.029244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.031275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.055749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:50.064680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:50.117643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 896/1795] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:49 2021] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:50.122597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.127337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:50.154290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5203e6a-690e-42d5-a40b-b9fbcadcf159 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.195993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.198319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.198630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.198910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] PATH_INFO: `/v3/projects/d35597d7102841b1826e76680999d388/users/ba4b0fe9cfb84b85be3cc0044c4852b8/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.263813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35597d7102841b1826e76680999d388, user_id=ba4b0fe9cfb84b85be3cc0044c4852b8, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.267534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49428c9-6aff-4a45-8071-c063a8be7e1f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.295287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 900/1796] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:58:49 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:50.298174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.315081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a409a6-2e1c-45c6-849e-f616bddb1db8 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.316439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 897/1797] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:50 2021] PUT /identity/v3/projects/d35597d7102841b1826e76680999d388/users/ba4b0fe9cfb84b85be3cc0044c4852b8/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:50.380986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.382699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.383132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.430339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] MFA Rules not processed for user `ba4b0fe9cfb84b85be3cc0044c4852b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:50.432559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:50.489672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.490373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.490680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.490946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.491701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.499224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.537407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 901/1798] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:50.537771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.559977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297d50b-aed9-4704-8973-e7fe59f39598 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.579238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.580834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.581135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.581415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.582184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.588048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.617253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 902/1799] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:50 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:50.622326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.641541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aaee2-e250-4477-b8ea-372c111e261e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.668954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.671363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.672623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.680600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] PATH_INFO: `/v3/projects/a1509fc69a4d4ff782745b7bb2c12e64/users/68cc63fa5e25491696d0c6e384085e5f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.688792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 898/1800] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:50 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:50.693856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.722113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b008b9-b164-4970-ab24-a6d608d2d7bc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:50.734938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1509fc69a4d4ff782745b7bb2c12e64, user_id=68cc63fa5e25491696d0c6e384085e5f, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.745763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b4445-f68e-4d7e-ab54-d8a69f3c18ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.745985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:50.747348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.747348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.747610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.748307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:50.750223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:50.785325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 903/1801] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:50 2021] PUT /identity/v3/projects/a1509fc69a4d4ff782745b7bb2c12e64/users/68cc63fa5e25491696d0c6e384085e5f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:50.791118 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:50.791401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:50.791677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:50.851800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 899/1802] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:50 2021] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:50.857094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:50.886647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] MFA Rules not processed for user `68cc63fa5e25491696d0c6e384085e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:50.889237 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.074482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d875d5-2181-4c35-901c-089bdd53c950 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.106448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.107353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.107734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.107930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.108650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.110608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.116200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 904/1803] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:50 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:51.117381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.121697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.178397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 900/1804] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:50 2021] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:51.179311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.190847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.220895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2158da9-91fb-41cf-b1a2-743268a5409d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.285868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.290297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.291270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.294243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] PATH_INFO: `/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.303194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7dc3865ca9437ebfe2cd58507e6ceb)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.308168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.336643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6b78c-603c-4f74-bd53-8af73817226c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.345687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.346185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.346718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.347409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.368298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.370678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dde1-646f-426a-9aea-24afc5cd711a service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.414290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 905/1805] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:51.415812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.416100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.416373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.425765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7dc3865ca9437ebfe2cd58507e6ceb', 'request_id': 'req-76a9d496-8096-4721-95bc-3c783f2496a6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.438256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7dc3865ca9437ebfe2cd58507e6ceb', 'request_id': 'req-76a9d496-8096-4721-95bc-3c783f2496a6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.451529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7dc3865ca9437ebfe2cd58507e6ceb', 'request_id': 'req-76a9d496-8096-4721-95bc-3c783f2496a6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.451967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] MFA Rules not processed for user `cf41c7302e554aec800fd923d12c77b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:51.453633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.470383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] The token cache is being invalidate because project 6f7dc3865ca9437ebfe2cd58507e6ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:51.470993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.471843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.473596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 901/1806] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:51 2021] DELETE /identity/v3/projects/6f7dc3865ca9437ebfe2cd58507e6ceb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:51.475506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.477988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.584166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d496-8096-4721-95bc-3c783f2496a6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.605979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.607037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.607383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.607723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] PATH_INFO: `/v3/projects/05302d7328a345e8881186fa48aa296a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.611294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05302d7328a345e8881186fa48aa296a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.614761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.656076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 906/1807] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:51 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:51.656076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.658656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.710137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68737368-1fd5-4c1f-b76c-2716aa7478a0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.725639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05302d7328a345e8881186fa48aa296a', 'request_id': 'req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.743332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05302d7328a345e8881186fa48aa296a', 'request_id': 'req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.763880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05302d7328a345e8881186fa48aa296a', 'request_id': 'req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.784086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] The token cache is being invalidate because project 05302d7328a345e8881186fa48aa296a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:51.784449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.785584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:51.788060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 902/1808] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:51 2021] DELETE /identity/v3/projects/05302d7328a345e8881186fa48aa296a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:51.789377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.790956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.809974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.810779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.811128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.811463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.812398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.814448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c2ce-26f3-4c0b-ade4-c8ed9cd04f0c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.859028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 907/1809] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:51 2021] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:51.859028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.859028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.859028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.884313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:51.886288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.965642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbe5a5-dc75-40ac-a09d-ff4bfe7e9e70 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:51.970618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 908/1810] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:51.971554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:51.972833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:51.982462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:51.983373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:51.983551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:51.983931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:51.984895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:51.987856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb94b78-73f9-4df7-8927-43b7ebe413fe admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:51.997893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dacdd-264b-4c06-a3be-83e5129be4b2 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.011166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c873f-658e-481c-b530-997986145548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.013893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c873f-658e-481c-b530-997986145548 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.014182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c873f-658e-481c-b530-997986145548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.014572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c873f-658e-481c-b530-997986145548 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.015497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c873f-658e-481c-b530-997986145548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.017050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 903/1811] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:51 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:52.018914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc281e-3fa5-4e57-a5c7-3085d1052591 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.019269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc281e-3fa5-4e57-a5c7-3085d1052591 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.019613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc281e-3fa5-4e57-a5c7-3085d1052591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.022012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c873f-658e-481c-b530-997986145548 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.055904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-92bc281e-3fa5-4e57-a5c7-3085d1052591 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:52.057728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-92bc281e-3fa5-4e57-a5c7-3085d1052591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:52.077484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 909/1812] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:51 2021] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.077484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c873f-658e-481c-b530-997986145548 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.086146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 904/1813] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:52.087544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.087832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.088365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.090954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f83c873f-658e-481c-b530-997986145548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:52.131980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:52.135085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:52.209694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c873f-658e-481c-b530-997986145548 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.214827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.215700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.215972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.216241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.217088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.219067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.225686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 905/1814] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:52.227117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.239094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82027d83-cacd-460f-baff-1be155ebc7ee None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.244332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.245457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.245890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.246665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 910/1815] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.246967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] PATH_INFO: `/v3/projects/0e88f590a57b478a9857c2c335d73c46/users/f35cb94456d94e78b5bc77d9dc0e1a2d/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.247648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.258373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eccef-6328-4697-a21b-b395a5cf5867 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.265565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.266619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.266909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.267326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.267835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e88f590a57b478a9857c2c335d73c46, user_id=f35cb94456d94e78b5bc77d9dc0e1a2d, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.268201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.270431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.270954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84b929-2d50-45fe-9206-e997297f2e1c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.294612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 906/1816] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:52 2021] PUT /identity/v3/projects/0e88f590a57b478a9857c2c335d73c46/users/f35cb94456d94e78b5bc77d9dc0e1a2d/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:52.297886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.298239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.298662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.299890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 911/1817] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/users => generated 309 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.300977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.323190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:52.324933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:52.325519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7bd62-bbce-4fed-a7eb-07755eca3af9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.413021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 907/1818] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:52.414180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.423591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.424374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.424721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.425027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bb779-a948-4481-a63c-9857c82809e1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.425146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.426485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:52.426808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.428811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.430794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.431782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.432205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.432627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.433507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.435788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.447029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 912/1819] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:52.447930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.450675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 908/1820] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:52.451950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.460458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8702-da55-46bb-92dd-80cd455a22ea admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.463824 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49975-fd29-4658-bba6-6f8a4a75c5b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.466649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.467485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.467906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.468051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.468787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.470542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.483177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.483177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.483177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.483177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.483654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.483654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.483925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 913/1821] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:52.483925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.495359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e01b-af05-4d03-a2dd-8511be0a1e5b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.501305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.502040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.502356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.502715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.503523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:52.503843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.505561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.508097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 909/1822] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:52.509170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.522237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cd582-3bc5-456f-b196-a5b7b9a450f1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.530230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 914/1823] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:52.531549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.544971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.546405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf727c6-6717-4aef-8d17-6c4c0d4d0e52 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.547370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.547854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.549048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.549937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.552685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.553953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.555300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.555957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.556268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] PATH_INFO: `/v3/projects/1bd98c25e57846b79bd6f5600b41981c/users/89aaacbe174d4467883b7933fefeae17/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.577094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd98c25e57846b79bd6f5600b41981c, user_id=89aaacbe174d4467883b7933fefeae17, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.580584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.590726 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 910/1824] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/projects => generated 357 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.591952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.601601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 915/1825] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:52 2021] PUT /identity/v3/projects/1bd98c25e57846b79bd6f5600b41981c/users/89aaacbe174d4467883b7933fefeae17/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:52.606146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.689581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec03db-0a39-49a8-9a79-cabf0d3278cc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.701584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c13719-43dd-44f8-aaf0-ef5fc214bcc7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.706556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.707460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.707741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.708015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] PATH_INFO: `/v3/projects/f1ba251d5d764a0793199f2f276a3a45/users/0baff2b7aff64d1eb9e9daf98f2cbf28/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.734424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ba251d5d764a0793199f2f276a3a45, user_id=0baff2b7aff64d1eb9e9daf98f2cbf28, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.737452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.761755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 916/1826] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:52 2021] PUT /identity/v3/projects/f1ba251d5d764a0793199f2f276a3a45/users/0baff2b7aff64d1eb9e9daf98f2cbf28/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:52.761755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.771278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.773325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.773802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.774491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] PATH_INFO: `/v3/projects/0e88f590a57b478a9857c2c335d73c46/users/f35cb94456d94e78b5bc77d9dc0e1a2d/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.777622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e88f590a57b478a9857c2c335d73c46, user_id=f35cb94456d94e78b5bc77d9dc0e1a2d, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.780446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.790782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 911/1827] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:52 2021] PUT /identity/v3/projects/0e88f590a57b478a9857c2c335d73c46/users/f35cb94456d94e78b5bc77d9dc0e1a2d/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:52.791630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.823932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e2b7-132f-4baf-942f-ad565b8abdc6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.859678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abd8f2-f27b-45e2-89d9-8c15998a9e51 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.865818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.866809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.867085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.867562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.868415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.871054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.905023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 912/1828] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/users => generated 279 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.905023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.908702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.908702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.908702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.908702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.909173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.911121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.924001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cfdf0-e1da-4d4a-b3c5-64f0a853a99c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:52.936372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:52.937169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.937532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.937910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.941184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:52.943020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53d920-d12b-4f50-8ddc-aa0206805758 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:52.952433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 917/1829] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:52.954187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:52.954558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 913/1830] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:52.955977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:52.956279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:52.956539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:52.990680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] MFA Rules not processed for user `f35cb94456d94e78b5bc77d9dc0e1a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:52.992073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.051366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be88b8-38ea-4275-8f4c-c5a8adf5f660 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.058236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.058960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.059949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.060165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.061180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.063981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.082462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 914/1831] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:52 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:53.082462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.082875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 918/1832] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:52 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:53.082953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.094397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fc9a-848e-4430-b1f8-a429ddedc3e8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.099530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.100306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.100665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.101003 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.101777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.104246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.108052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaad84-c665-4f9a-9ced-27eb1f820647 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.120335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.121321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.121846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.122558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.123066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.126899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.139856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 919/1833] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:53 2021] POST /identity/v3/users => generated 292 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:53.143754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.159516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 915/1834] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:53.160358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.163451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f930248-8459-4652-8403-2bfccd87a233 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.176173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.176991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.177277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.177550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] PATH_INFO: `/v3/projects/1bd98c25e57846b79bd6f5600b41981c/users/89aaacbe174d4467883b7933fefeae17/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.179090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b9de3-6fb6-4694-9ee2-ca42c2d5b372 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.182954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd98c25e57846b79bd6f5600b41981c, user_id=89aaacbe174d4467883b7933fefeae17, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.192410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.198876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.200131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.200825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.200825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] PATH_INFO: `/v3/projects/f1ba251d5d764a0793199f2f276a3a45/users/0baff2b7aff64d1eb9e9daf98f2cbf28/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.204779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ba251d5d764a0793199f2f276a3a45, user_id=0baff2b7aff64d1eb9e9daf98f2cbf28, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.206212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.221092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 916/1835] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:53 2021] PUT /identity/v3/projects/f1ba251d5d764a0793199f2f276a3a45/users/0baff2b7aff64d1eb9e9daf98f2cbf28/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:53.221092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.224202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.312986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52f7c7-c5bd-44c0-9b56-860fc20b3707 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.317520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.318453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.318792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.319057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.377838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 920/1836] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:53 2021] PUT /identity/v3/projects/1bd98c25e57846b79bd6f5600b41981c/users/89aaacbe174d4467883b7933fefeae17/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:53.379035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.413375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.415077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.438140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 917/1837] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:53.438140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.551591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8e2b-0e9c-4e15-99e0-f87aa5f9f038 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.552753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8152d6-ad58-454a-8cdf-3179c1261c69 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.563832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.563832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.564155 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.564224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.564304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.564880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.564987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.565155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.565435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.566278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.566631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b4653-9750-44ee-ae37-078b2792b80e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.568137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.581800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 921/1838] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:53.583761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.584328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.584498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.596899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 918/1839] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:53.597469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.607674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2173ae-d6fb-486a-8850-5084c7eb7a07 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.616286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.617048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.617310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.617582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.620458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.649346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] MFA Rules not processed for user `89aaacbe174d4467883b7933fefeae17`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:53.650578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.738281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.739887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.749757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 922/1840] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:53 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:53.751539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.754491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 919/1841] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:53.755990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.774419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98625-8aff-4483-8e60-e0c05bb66c21 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.778921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eae5c-5198-4fec-95ef-882679f5b999 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.786900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.787593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.787872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.788142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.789950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.791624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.793085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.795059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.795366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.795642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] PATH_INFO: `/v3/projects/ebccd655a98d4b5b93e2c023ae79fa4c/users/7bf038c92bd842f4a02ad54769b49a6f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.817367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebccd655a98d4b5b93e2c023ae79fa4c, user_id=7bf038c92bd842f4a02ad54769b49a6f, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.820088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:53.827179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 923/1842] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:53.827179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.830774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.851088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faf3e3-0166-4ca3-89f1-d9354746dd0d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.862958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 920/1843] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:53 2021] PUT /identity/v3/projects/ebccd655a98d4b5b93e2c023ae79fa4c/users/7bf038c92bd842f4a02ad54769b49a6f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:53.864162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:53.948845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fd0a-eae5-447c-9e99-1ac91bfbdcaa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:53.959884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.960811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.961088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.962885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] PATH_INFO: `/v3/projects/364dd8f9d0f14aa3883710c4a9efe1b4/users/419cd9f6a0d84e248d41a2b0b4fba084/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.972722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:53.974103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:53.974413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:53.974734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:53.976989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:53.982213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364dd8f9d0f14aa3883710c4a9efe1b4, user_id=419cd9f6a0d84e248d41a2b0b4fba084, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:53.986281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566b58e-8b8e-431e-9cce-0ed05271af27 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.008829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 921/1844] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:53 2021] PUT /identity/v3/projects/364dd8f9d0f14aa3883710c4a9efe1b4/users/419cd9f6a0d84e248d41a2b0b4fba084/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:54.010652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.010937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.011205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.045885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] MFA Rules not processed for user `7bf038c92bd842f4a02ad54769b49a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:54.047123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.063423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.065015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85157edd-ea91-4846-8e19-a90f6cb67291 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.083685 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 924/1845] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:53 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:54.085302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b477de-a6d7-44d7-a39b-0e50c5faf5b4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.086819 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b477de-a6d7-44d7-a39b-0e50c5faf5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.087146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b477de-a6d7-44d7-a39b-0e50c5faf5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.127300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-46b477de-a6d7-44d7-a39b-0e50c5faf5b4 None None] MFA Rules not processed for user `419cd9f6a0d84e248d41a2b0b4fba084`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:54.128528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-46b477de-a6d7-44d7-a39b-0e50c5faf5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.145668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 922/1846] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:54.146540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.223799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f9016-0a86-44d1-aff7-402e3516be38 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.243356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.246169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.247197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.247762 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] PATH_INFO: `/v3/users/ba4b0fe9cfb84b85be3cc0044c4852b8` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.249679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4b0fe9cfb84b85be3cc0044c4852b8)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.253783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.256128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 925/1847] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:54.257953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.258368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.259041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.316435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] MFA Rules not processed for user `0baff2b7aff64d1eb9e9daf98f2cbf28`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:54.319009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.344088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4b0fe9cfb84b85be3cc0044c4852b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:54.365708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4b0fe9cfb84b85be3cc0044c4852b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:54.367300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4b0fe9cfb84b85be3cc0044c4852b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:54.386887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4b0fe9cfb84b85be3cc0044c4852b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:54.387985 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4b0fe9cfb84b85be3cc0044c4852b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:54.439390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 923/1848] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:54 2021] DELETE /identity/v3/users/ba4b0fe9cfb84b85be3cc0044c4852b8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:54.439390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.439390 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.457933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 926/1849] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:54.459527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.463206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.518288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1202d3-9564-48b6-8ce3-1dec6c46867d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.523624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.524346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.525334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.525611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.526377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.528704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53627de-e4e9-4e5b-b539-6de6bc695be2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.588310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 924/1850] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/projects => generated 357 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:54.591575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.594223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.594345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.615983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1c128-7ed3-46b8-9546-d7c9db456b96 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.640490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:54.641710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.733149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.733943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.734248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.734687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.740388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.772159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 925/1851] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:54.774722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.804776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94316-22fb-4fde-b066-8d044ec32d60 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.809320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.809960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.810238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.810523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.811268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.813197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.850222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 926/1852] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:54 2021] POST /identity/v3/users => generated 285 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:54.850222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.860656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.865422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.867170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.878168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 927/1853] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:54 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:54.879196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.894393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8b9da-3418-4d5d-b5d5-a45c65a36a19 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.904750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.906255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.906823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.907360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.908205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.911025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.926016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 928/1854] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:54.926016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.926723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:54.941114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60d91b-1bfa-4155-8e91-d8b97b76192f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.947360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4835ad-5763-4e4e-8ed2-b718cf59b523 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:54.947656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.948734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.949217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.949933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] PATH_INFO: `/v3/users/419cd9f6a0d84e248d41a2b0b4fba084` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.951742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419cd9f6a0d84e248d41a2b0b4fba084)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.952055 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:54.952719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:54.953052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:54.953321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:54.955068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.966675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:54.968428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:54.986481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 927/1855] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:54.987723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:54.999032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b177547-dda4-489c-b094-57d01f27976a service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.004973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.006107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.006223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.006434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] PATH_INFO: `/v3/projects/cd50651babe545f0bf7f21ecd764d505/users/c9c3e454388d4456872d649483e66cc4/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.017937 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419cd9f6a0d84e248d41a2b0b4fba084'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:55.027498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419cd9f6a0d84e248d41a2b0b4fba084'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:55.028470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419cd9f6a0d84e248d41a2b0b4fba084'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:55.041007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419cd9f6a0d84e248d41a2b0b4fba084'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:55.060582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a3c6da29-c78f-485d-9fca-fb9cf581a6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419cd9f6a0d84e248d41a2b0b4fba084'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:55.072148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 929/1856] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:54 2021] DELETE /identity/v3/users/419cd9f6a0d84e248d41a2b0b4fba084 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:55.076308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.076962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.077468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.097572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:55.099187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.157705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd50651babe545f0bf7f21ecd764d505, user_id=c9c3e454388d4456872d649483e66cc4, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.162186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.179827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 930/1857] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:55.180282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 928/1858] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:54 2021] PUT /identity/v3/projects/cd50651babe545f0bf7f21ecd764d505/users/c9c3e454388d4456872d649483e66cc4/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:55.183954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:55.187092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.198727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37be73-b3b5-481c-88d2-9b7764d6be27 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.228564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:55.230910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.289736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.290343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.290654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.291511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.292948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.307708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.338253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 931/1859] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:55 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:55.339241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:55.362310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4656-f04b-4468-b949-363a4b0d5df0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.369840 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c7a4b-7354-46ca-a7ee-f6a1eb586f21 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.374561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.375284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.375664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.375993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.376177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.377065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.377341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.377610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] PATH_INFO: `/v3/projects/cd50651babe545f0bf7f21ecd764d505/users/c9c3e454388d4456872d649483e66cc4/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.384664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd50651babe545f0bf7f21ecd764d505, user_id=c9c3e454388d4456872d649483e66cc4, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.388066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.388901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.390338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000e8e9-87d4-40c8-89f0-a8c66ab92c5f service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.401664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 929/1860] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:55.408457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 932/1861] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:55 2021] PUT /identity/v3/projects/cd50651babe545f0bf7f21ecd764d505/users/c9c3e454388d4456872d649483e66cc4/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:55.419922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.420367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.420780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.463198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] MFA Rules not processed for user `c9c3e454388d4456872d649483e66cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:55.464782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.546008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 930/1862] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:55 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:55.557344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:55.559622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.661956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de2eb5-be04-44d7-8906-a86f2adf5443 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.666562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.667215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.667494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.667762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.677802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.680449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.691036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 933/1863] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:55 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:55.791880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:55.793352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.805787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971dcc-2a91-43d6-914d-8ffed0d569ba None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:55.809643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:55.810319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:55.810624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:55.810899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:55.812811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:55.897734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:55.899333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:55.935561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 931/1864] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:55 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:56.628764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:56.633751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:56.712440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:56.738219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118ad5e-82b7-4035-a7f0-6a828a610720 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:56.743348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:56.744752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:56.744752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:56.744950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] PATH_INFO: `/v3/users/cf41c7302e554aec800fd923d12c77b4` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:56.758647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf41c7302e554aec800fd923d12c77b4)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:56.760729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:56.847385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2ce9f-4346-4555-8d28-8e64f7ff117a service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:56.850856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf41c7302e554aec800fd923d12c77b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:56.859552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf41c7302e554aec800fd923d12c77b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:56.860267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf41c7302e554aec800fd923d12c77b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:56.860374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:56.861357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:56.861892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:56.862124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] PATH_INFO: `/v3/users/7bf038c92bd842f4a02ad54769b49a6f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:56.864370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf038c92bd842f4a02ad54769b49a6f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:56.866307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:56.877004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf41c7302e554aec800fd923d12c77b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:56.893981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf41c7302e554aec800fd923d12c77b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:56.907836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 934/1865] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:56 2021] DELETE /identity/v3/users/cf41c7302e554aec800fd923d12c77b4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:56.982114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:56.983668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:56.990476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf038c92bd842f4a02ad54769b49a6f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.004524 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf038c92bd842f4a02ad54769b49a6f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.010078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf038c92bd842f4a02ad54769b49a6f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.034140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf038c92bd842f4a02ad54769b49a6f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.035678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-012a4b6b-cbc0-4dd9-bc0b-1a5a6105904c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf038c92bd842f4a02ad54769b49a6f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.066123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 932/1866] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:56 2021] DELETE /identity/v3/users/7bf038c92bd842f4a02ad54769b49a6f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:57.068187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.068466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.068733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.092760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:57.094147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.126502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b1f56-2c94-44e2-8a99-a28c99ce7130 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.230370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.231376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.231662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.231936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] PATH_INFO: `/v3/projects/d35597d7102841b1826e76680999d388` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.236292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35597d7102841b1826e76680999d388)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.238281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.257052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 933/1867] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:57.257052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:57.263114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.294664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f05fe-10e7-47a7-ada9-385e8d1aa11d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.329520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35597d7102841b1826e76680999d388', 'request_id': 'req-5e683e6e-b4c2-47ad-a405-bc83fa241719'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.338870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35597d7102841b1826e76680999d388', 'request_id': 'req-5e683e6e-b4c2-47ad-a405-bc83fa241719'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.349973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35597d7102841b1826e76680999d388', 'request_id': 'req-5e683e6e-b4c2-47ad-a405-bc83fa241719'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.368713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] The token cache is being invalidate because project d35597d7102841b1826e76680999d388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:57.369022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.369825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.372753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 935/1868] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:56 2021] DELETE /identity/v3/projects/d35597d7102841b1826e76680999d388 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:57.373661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:57.385252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.389280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.390221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.390542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.390830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] PATH_INFO: `/v3/projects/364dd8f9d0f14aa3883710c4a9efe1b4` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.392124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364dd8f9d0f14aa3883710c4a9efe1b4)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.394468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.401284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683e6e-b4c2-47ad-a405-bc83fa241719 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.407999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.409487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.410005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.410457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] PATH_INFO: `/v3/projects/686d4514ada0450fadf28cbc8fda9703` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.411885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686d4514ada0450fadf28cbc8fda9703)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.414445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.463597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364dd8f9d0f14aa3883710c4a9efe1b4', 'request_id': 'req-c2dec41c-0739-41e3-a355-50bf379cb916'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.476175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364dd8f9d0f14aa3883710c4a9efe1b4', 'request_id': 'req-c2dec41c-0739-41e3-a355-50bf379cb916'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.487777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686d4514ada0450fadf28cbc8fda9703', 'request_id': 'req-3c1693fc-1794-4ae8-9ad2-0428a13504f4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.491754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364dd8f9d0f14aa3883710c4a9efe1b4', 'request_id': 'req-c2dec41c-0739-41e3-a355-50bf379cb916'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.498832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686d4514ada0450fadf28cbc8fda9703', 'request_id': 'req-3c1693fc-1794-4ae8-9ad2-0428a13504f4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.506305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686d4514ada0450fadf28cbc8fda9703', 'request_id': 'req-3c1693fc-1794-4ae8-9ad2-0428a13504f4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.517035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] The token cache is being invalidate because project 364dd8f9d0f14aa3883710c4a9efe1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:57.518258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.518973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.521193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] The token cache is being invalidate because project 686d4514ada0450fadf28cbc8fda9703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:57.521518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.526839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 934/1869] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:57 2021] DELETE /identity/v3/projects/364dd8f9d0f14aa3883710c4a9efe1b4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:57.526993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.527070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:57.527178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 936/1870] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:57 2021] DELETE /identity/v3/projects/686d4514ada0450fadf28cbc8fda9703 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:57.527249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.527324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:57.527668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.602935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dec41c-0739-41e3-a355-50bf379cb916 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.613896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1693fc-1794-4ae8-9ad2-0428a13504f4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.621089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.622045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.622423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.622589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] PATH_INFO: `/v3/users/f35cb94456d94e78b5bc77d9dc0e1a2d` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.623864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35cb94456d94e78b5bc77d9dc0e1a2d)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.625801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.689731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.690743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.691140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.691691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.695299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.697787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35cb94456d94e78b5bc77d9dc0e1a2d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.706678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35cb94456d94e78b5bc77d9dc0e1a2d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.708000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35cb94456d94e78b5bc77d9dc0e1a2d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.709646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.711517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df569-f220-421d-bdbd-dc03fbc918a1 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.718293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35cb94456d94e78b5bc77d9dc0e1a2d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.722995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 935/1871] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:57.724580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.724868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.725141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.747265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:57.748600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.757545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6d11df7e-f365-40c5-b2cb-caca853388c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35cb94456d94e78b5bc77d9dc0e1a2d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.758415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 936/1872] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:57.759565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:57.760801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.781666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57448dc5-4a09-40bd-b66c-0a460b0bedfb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:57.785696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:57.786832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.787289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.787641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 937/1873] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:57 2021] DELETE /identity/v3/users/f35cb94456d94e78b5bc77d9dc0e1a2d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:57.789042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:57.789332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:57.789607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.790627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] PATH_INFO: `/v3/users/0baff2b7aff64d1eb9e9daf98f2cbf28` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:57.793141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0baff2b7aff64d1eb9e9daf98f2cbf28)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:57.795807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:57.835717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:57.841944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:57.867735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0baff2b7aff64d1eb9e9daf98f2cbf28'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.880378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0baff2b7aff64d1eb9e9daf98f2cbf28'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.882266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0baff2b7aff64d1eb9e9daf98f2cbf28'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.909033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0baff2b7aff64d1eb9e9daf98f2cbf28'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.910658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0baff2b7aff64d1eb9e9daf98f2cbf28'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:57.936916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 937/1874] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:57 2021] DELETE /identity/v3/users/0baff2b7aff64d1eb9e9daf98f2cbf28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:57.958608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 938/1875] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:57.962593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.040113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34b29f-e4da-4ebf-b38b-abbea56cdd85 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.046199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.047020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.047851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.047851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.048621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:58.048802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.057443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.080293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 938/1876] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:58.085684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.095443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55879f-1490-4a2a-84cc-7399b9875812 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.104301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.105687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.106391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.111035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.112469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.117254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.157207 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 939/1877] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:58.158576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.171290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf7bfc-8457-47c8-b915-aa3cb4316541 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.243121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.244040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.244884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.245303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.246242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.249271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.280960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 939/1878] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:58.284583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.298936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06edb4b-aa2e-4079-aca9-5beb88c90f7a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.304605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.305308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.305593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.305935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.306780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.308480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.320569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 940/1879] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:58.325035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.338484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.341232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.341593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a10d3-efe9-47ce-bab1-4dee14b988dd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.354211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.354945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.355225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.355495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.356342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.358948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.370838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa615af2-1f0d-4798-bda1-550d1b12ecb0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.376578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.378002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.378440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.378919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] PATH_INFO: `/v3/projects/f1ba251d5d764a0793199f2f276a3a45` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.380404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ba251d5d764a0793199f2f276a3a45)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.384015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.386554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 940/1880] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:58.390757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.400542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977267bd-5b94-4fd9-9c9b-40d167984942 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.407211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.408230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.408515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.408795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] PATH_INFO: `/v3/projects/ef633082704a466ea178c4d5d67d780c/users/d9c0769714ad447db8104868f6439a21/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.426287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef633082704a466ea178c4d5d67d780c, user_id=d9c0769714ad447db8104868f6439a21, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.429338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06417177-90b5-4334-ae3b-676b1d283ecf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.442148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ba251d5d764a0793199f2f276a3a45', 'request_id': 'req-0ace8fdb-d1e3-4b98-b324-1239babcdb12'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.448922 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 941/1881] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:58 2021] PUT /identity/v3/projects/ef633082704a466ea178c4d5d67d780c/users/d9c0769714ad447db8104868f6439a21/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:58:58.459982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a95ba-9631-4d2a-b1ed-8ee9886e647a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.460347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a95ba-9631-4d2a-b1ed-8ee9886e647a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.460623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a95ba-9631-4d2a-b1ed-8ee9886e647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.464194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ba251d5d764a0793199f2f276a3a45', 'request_id': 'req-0ace8fdb-d1e3-4b98-b324-1239babcdb12'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.470421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ba251d5d764a0793199f2f276a3a45', 'request_id': 'req-0ace8fdb-d1e3-4b98-b324-1239babcdb12'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.483107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] The token cache is being invalidate because project f1ba251d5d764a0793199f2f276a3a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:58.483401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.484075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0ace8fdb-d1e3-4b98-b324-1239babcdb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.485976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 941/1882] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:58 2021] DELETE /identity/v3/projects/f1ba251d5d764a0793199f2f276a3a45 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:58.491964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.492260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.492694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.499885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8e0a95ba-9631-4d2a-b1ed-8ee9886e647a None None] MFA Rules not processed for user `d9c0769714ad447db8104868f6439a21`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:58.501417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8e0a95ba-9631-4d2a-b1ed-8ee9886e647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.515116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:58.516322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.584878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 942/1883] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:58:58.592840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 942/1884] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:58.594641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.594934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.595212 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.595448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.596818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.613769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:58.615003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.626696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 943/1885] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:58.627987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.638855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c08b-e888-4bac-923c-fce738b6d934 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.645249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.645918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.646214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.646460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.647302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:58.647602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.649734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.660303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f0e5d-fb78-445a-a054-1a95a0d47f0f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.664438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 944/1886] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:58.667925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.667925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.667925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.667925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.668933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.676302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.677750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.679076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84091b80-142d-4700-a99d-78e79cca18be admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.684801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.685458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.685772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.686064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.686755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.687741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 943/1887] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:58:58.688679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.722365 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 945/1888] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:58:58.723632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.741391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b8ae9-5333-4a47-ba43-fec80c8959d3 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.806904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.808020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.808392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.808968 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.809959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.814805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.816245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.818597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.844430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962ca92-8638-4240-a701-fe6ee9c178b7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.861042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.864179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.864179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.865454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] PATH_INFO: `/v3/projects/0e88f590a57b478a9857c2c335d73c46` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.878420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 944/1889] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:58 2021] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:58.886201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.890565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e88f590a57b478a9857c2c335d73c46)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.896154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.922714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86180c4f-d04a-4468-b787-46b0369b75b2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:58.929010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:58.931036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:58.931499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:58.932061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:58.933029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:58.934943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:58.949210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 945/1890] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:58.953545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:58.956727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:58.986097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e88f590a57b478a9857c2c335d73c46', 'request_id': 'req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:58.998620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e88f590a57b478a9857c2c335d73c46', 'request_id': 'req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.007930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e88f590a57b478a9857c2c335d73c46', 'request_id': 'req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.023193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] The token cache is being invalidate because project 0e88f590a57b478a9857c2c335d73c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:59.024030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.025108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.028021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 946/1891] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:58 2021] DELETE /identity/v3/projects/0e88f590a57b478a9857c2c335d73c46 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:59.031550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.038316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.057567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d2a8-debd-48f4-8474-a926d065bcd1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.172633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.172633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.172633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.172953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.175961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.182745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4fee-cb03-4d6d-a6b9-00d0989f3610 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.191945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.193156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.193156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.193447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.194277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.195971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.222751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 947/1892] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:58:59 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:58:59.224265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.227760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.244797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54156c-26f6-4dc8-bd3e-b9e2fb1f19b3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.256099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.256798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.257073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.257342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] PATH_INFO: `/v3/projects/ebccd655a98d4b5b93e2c023ae79fa4c` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.258949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebccd655a98d4b5b93e2c023ae79fa4c)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.260991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.277436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.279719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068d195-2538-46b4-8037-3f2d88849a7b service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.293809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 946/1893] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:58:58 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:58:59.295900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.296445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.296932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.324832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebccd655a98d4b5b93e2c023ae79fa4c', 'request_id': 'req-2d084979-e80c-42d5-a354-9312f01c20ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.333091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:59.337659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.339143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebccd655a98d4b5b93e2c023ae79fa4c', 'request_id': 'req-2d084979-e80c-42d5-a354-9312f01c20ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.359209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebccd655a98d4b5b93e2c023ae79fa4c', 'request_id': 'req-2d084979-e80c-42d5-a354-9312f01c20ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.381174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] The token cache is being invalidate because project ebccd655a98d4b5b93e2c023ae79fa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:58:59.381469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.382444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.384615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 948/1894] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:58:59 2021] DELETE /identity/v3/projects/ebccd655a98d4b5b93e2c023ae79fa4c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:59.389663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.391396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.435919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 947/1895] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:59.437106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.448057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.470548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cb31d-3a2e-4ad2-b5b6-132814addf8f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.476597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.477725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.477874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.478154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] PATH_INFO: `/v3/users/c9c3e454388d4456872d649483e66cc4` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.479508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c3e454388d4456872d649483e66cc4)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.482194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.525209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d084979-e80c-42d5-a354-9312f01c20ca admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.537461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.540280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.541465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.542681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] PATH_INFO: `/v3/projects/f81ac9c267a74ca1afaa5ef67c11049f/users/6bea9b83e59041a8af724ce82b6f7e9a/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.554330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c3e454388d4456872d649483e66cc4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.567592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81ac9c267a74ca1afaa5ef67c11049f, user_id=6bea9b83e59041a8af724ce82b6f7e9a, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.572220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa3320-cab3-49b1-b927-cd37e9f1d485 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.581669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c3e454388d4456872d649483e66cc4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.583191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c3e454388d4456872d649483e66cc4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.592271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c3e454388d4456872d649483e66cc4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.596320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 949/1896] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:58:59 2021] PUT /identity/v3/projects/f81ac9c267a74ca1afaa5ef67c11049f/users/6bea9b83e59041a8af724ce82b6f7e9a/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:59.597853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.598192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.598488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.608065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-af908e9b-a165-4cf8-b91f-30479d0d9d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c3e454388d4456872d649483e66cc4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:58:59.623802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:59.625075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.640045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 948/1897] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:58:59 2021] DELETE /identity/v3/users/c9c3e454388d4456872d649483e66cc4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:58:59.642718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.642718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.642718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.679952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] MFA Rules not processed for user `6bea9b83e59041a8af724ce82b6f7e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:58:59.681171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.711612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 950/1898] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:59.716353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.729418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdd4d4-65ec-4b56-96c9-cc92498428d6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.750878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 949/1899] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:58:59.752864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.753341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:58:59.837454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42309f9-f304-4d12-8a25-acd3f80ba1bf None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.843763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.844478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.844760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.845037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.845763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.847848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.867852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.868603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.869202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.869485 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.870784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:58:59.871104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.873692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.879561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 950/1900] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:58:59.883890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.891620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 951/1901] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:58:59.898878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:58:59.913008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae2bb-d458-4be7-a821-563d21cd398a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.971805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf02c-9a51-486d-96a7-fc965f8c7365 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:58:59.977081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.977758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.978040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.978314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.978449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:58:59.979060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.979607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:58:59.979963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:58:59.980308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:58:59.981064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:58:59.981224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:58:59.983592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.012204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 951/1902] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:00.016221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.027194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 952/1903] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:58:59 2021] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:00.029314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.042762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128d446-b43b-4c1a-8b72-6c1b62d6a9aa admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.129177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf5a39-c689-4a5f-bddd-211e7b47ae39 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.135469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.136095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.136437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.136772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.137632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.139785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.143228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.144142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.144566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.145695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.146941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.150671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.161874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 952/1904] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:00.163126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.167194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.171750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 953/1905] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:00.171750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.181121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495df22-3de3-4d81-9c07-721abd4d8318 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.181854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d15f1-e423-4628-b3c8-7a70166ec0ec admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.185823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.186719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.186994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.187260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] PATH_INFO: `/v3/projects/cd50651babe545f0bf7f21ecd764d505` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.188433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd50651babe545f0bf7f21ecd764d505)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.190349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.194977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.196669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.197023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.197803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] PATH_INFO: `/v3/projects/89a7ef8571314c7fbd7625fba73e3177/users/c27a41e54ff2413abf222b2913780be1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.215428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a7ef8571314c7fbd7625fba73e3177, user_id=c27a41e54ff2413abf222b2913780be1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.218991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.275052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 954/1906] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:00 2021] PUT /identity/v3/projects/89a7ef8571314c7fbd7625fba73e3177/users/c27a41e54ff2413abf222b2913780be1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:00.275052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.282204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd50651babe545f0bf7f21ecd764d505', 'request_id': 'req-b60eb9da-6d05-432a-9188-bd9e689d909c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:00.302857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd50651babe545f0bf7f21ecd764d505', 'request_id': 'req-b60eb9da-6d05-432a-9188-bd9e689d909c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:00.315613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd50651babe545f0bf7f21ecd764d505', 'request_id': 'req-b60eb9da-6d05-432a-9188-bd9e689d909c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:00.344608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] The token cache is being invalidate because project cd50651babe545f0bf7f21ecd764d505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:00.344897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:00.349388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:00.351116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 953/1907] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:00 2021] DELETE /identity/v3/projects/cd50651babe545f0bf7f21ecd764d505 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:00.351879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.356066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.418980 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48343219-40d2-4ac4-88a8-37ea2d3d1c75 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.427645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.429264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.429753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.430229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.431245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.439482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee288e-d04a-4a5e-ab35-d2787b5e4a84 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.455368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 955/1908] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:00.457932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.458280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.458658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.463989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb9da-6d05-432a-9188-bd9e689d909c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.469669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.470350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.470661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.471037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.472020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.473690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.489434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 954/1909] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:00.490650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.493034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.503722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:00.505183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.507395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf535-b0a2-4673-8775-c26df1750f9f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.516226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.516911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.517191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.517509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.518362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.520004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492601-db0d-4e9c-a892-997b4b8927f6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.527053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 956/1910] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:00.527053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.533377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 955/1911] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:00.538961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db77a1-1209-4234-8be3-2eaa698051a6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.539341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f7f7-6b9d-4e72-a734-727c80c28dfa None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.539919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f7f7-6b9d-4e72-a734-727c80c28dfa None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.540381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f7f7-6b9d-4e72-a734-727c80c28dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.561447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.562376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.562689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.562966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] PATH_INFO: `/v3/projects/89a7ef8571314c7fbd7625fba73e3177/users/c27a41e54ff2413abf222b2913780be1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.565015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a7ef8571314c7fbd7625fba73e3177, user_id=c27a41e54ff2413abf222b2913780be1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.571244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.576309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-bef3f7f7-6b9d-4e72-a734-727c80c28dfa None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:00.578392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-bef3f7f7-6b9d-4e72-a734-727c80c28dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.583679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 957/1912] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:00 2021] PUT /identity/v3/projects/89a7ef8571314c7fbd7625fba73e3177/users/c27a41e54ff2413abf222b2913780be1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:00.586446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.687593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 956/1913] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:00.687593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434358a-9d0b-4ab5-a3dd-9287ae8c4dd0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.687593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434358a-9d0b-4ab5-a3dd-9287ae8c4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.688281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434358a-9d0b-4ab5-a3dd-9287ae8c4dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.699628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87bd4-2515-492d-8677-44684f3e3d82 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.713382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.715167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.715466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.715892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] PATH_INFO: `/v3/projects/6fd92e45bdad47c6aab865d065ef9037/users/9e837071d7b54fc69410f5bd9e60fb52/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.739232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd92e45bdad47c6aab865d065ef9037, user_id=9e837071d7b54fc69410f5bd9e60fb52, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.743571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.751974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9434358a-9d0b-4ab5-a3dd-9287ae8c4dd0 None None] MFA Rules not processed for user `c27a41e54ff2413abf222b2913780be1`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:00.753758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9434358a-9d0b-4ab5-a3dd-9287ae8c4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.764444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 958/1914] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:00 2021] PUT /identity/v3/projects/6fd92e45bdad47c6aab865d065ef9037/users/9e837071d7b54fc69410f5bd9e60fb52/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:00.765344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.836191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 957/1915] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/auth/tokens => generated 3295 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:00.837860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.838195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.838891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.859166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c40474-4a2f-4784-809b-bd59a616a27b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.867209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.867529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.867975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.868256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.869440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:00.869749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.872733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:00.880320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] MFA Rules not processed for user `9e837071d7b54fc69410f5bd9e60fb52`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:00.881905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.891336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 959/1916] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:00.891336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.893821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:00.970917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 958/1917] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:00.971829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:00.977198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97cbc3-d034-472a-9adb-1a4556095776 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.983159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2d42b-760e-47af-bd17-5450a8ada105 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:00.990200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:00.991008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:00.991365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:00.991721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:00.992631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:00.995107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.003845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.004769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.005871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.005871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.028031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.035940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 959/1918] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:00 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:01.035940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.036205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.052341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 960/1919] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:00 2021] GET /identity/v3/auth/tokens => generated 3295 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:01.053627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.066486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ba0e-c064-4958-a672-aba795fa8a3b service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.180692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c904dc-e0a7-4a93-9781-6baa21809760 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.191241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.191936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.192219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.192493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.193213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.196234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.216773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.217465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.217831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.218164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.219066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.221030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.258258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 961/1920] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:01.258340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 960/1921] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:01.258413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.261336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.290186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b7cf4-5981-4898-8d40-aec823b9da9a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.373987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73d20-27b8-41c4-8e74-b293a5f897f4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.379805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.380506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.380790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.381238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.382103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.385571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.450175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 961/1922] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:01.455804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.470955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d859-5b0f-4d32-84df-62db530f2687 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.484705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.484840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.486049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.486171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.486250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.486331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.486331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.486461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.487160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.488926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.489083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.495367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.506464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 962/1923] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:01.512678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.516990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 962/1924] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:01.524649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.526877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb6b1e-9af1-44dd-88dc-cc7715a591f4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.532744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.533526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.533875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.534238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.535347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.537473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.549500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 963/1925] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:01.554444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.563530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391f057-a0df-4393-8bf3-3ea3381198c0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.568000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ef86a-be87-4551-85e1-83846289d322 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.573676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.578330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.579136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.579407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.579507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.580258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] PATH_INFO: `/v3/projects/9e409bec8f45490c82be8aef4b6ef74a/users/c0c34ff4d3f04ff99f6fe850b73d9582/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.581163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.581686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] PATH_INFO: `/v3/projects/f35a0ace4798408eb324843d6b8986e4/users/7a032a8aafaf42eca414ed7fee6e2c53/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.616381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35a0ace4798408eb324843d6b8986e4, user_id=7a032a8aafaf42eca414ed7fee6e2c53, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.622867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec4de4-4cf0-4d3f-866a-24421a3de914 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.625186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e409bec8f45490c82be8aef4b6ef74a, user_id=c0c34ff4d3f04ff99f6fe850b73d9582, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.635037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.675581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 963/1927] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:01 2021] PUT /identity/v3/projects/9e409bec8f45490c82be8aef4b6ef74a/users/c0c34ff4d3f04ff99f6fe850b73d9582/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:01.677502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.681001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 964/1927] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:01 2021] PUT /identity/v3/projects/f35a0ace4798408eb324843d6b8986e4/users/7a032a8aafaf42eca414ed7fee6e2c53/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:01.682667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.682950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.683226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.720167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] MFA Rules not processed for user `7a032a8aafaf42eca414ed7fee6e2c53`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:01.722151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:01.782095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa482-1f95-4898-8f3a-71e97dd05202 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.788558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.789949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.790233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.790528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] PATH_INFO: `/v3/users/6bea9b83e59041a8af724ce82b6f7e9a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.791841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bea9b83e59041a8af724ce82b6f7e9a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.794014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.802456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 965/1928] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:01.803587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.815877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b69dfa-1645-476d-840e-cbb825836be4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.821232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.822019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.822308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.822867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.823706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.825581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.837338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 966/1929] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:01.838249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.851145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48456-a66c-4998-a77f-432602c801b3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:01.853738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bea9b83e59041a8af724ce82b6f7e9a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:01.856708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:01.857597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:01.858030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:01.858305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:01.859073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:01.861955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:01.862879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bea9b83e59041a8af724ce82b6f7e9a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:01.863603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bea9b83e59041a8af724ce82b6f7e9a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:01.872597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bea9b83e59041a8af724ce82b6f7e9a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:01.893018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bea9b83e59041a8af724ce82b6f7e9a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:01.899196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 967/1930] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:01.903109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.908216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 964/1931] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:01 2021] DELETE /identity/v3/users/6bea9b83e59041a8af724ce82b6f7e9a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:01.908216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:01.908462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:01.910990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.039043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130b03d-18b5-4ece-b7e1-b6719910bca5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.054454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.055184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.055471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.055737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.056456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.058394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e71a19-3869-46b5-adfc-7bf9c221f663 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.061624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1bf79-7b68-452e-9154-54ab406d2d90 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.067684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.069109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.069452 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.069728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] PATH_INFO: `/v3/projects/9e409bec8f45490c82be8aef4b6ef74a/users/c0c34ff4d3f04ff99f6fe850b73d9582/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.083162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e409bec8f45490c82be8aef4b6ef74a, user_id=c0c34ff4d3f04ff99f6fe850b73d9582, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.095334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.099332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 965/1932] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:01 2021] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:02.100981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26978a1-3bc6-4377-99c0-2e9cb4dbf3ed None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.101308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26978a1-3bc6-4377-99c0-2e9cb4dbf3ed None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.101561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26978a1-3bc6-4377-99c0-2e9cb4dbf3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.121760 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 968/1933] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:01 2021] PUT /identity/v3/projects/9e409bec8f45490c82be8aef4b6ef74a/users/c0c34ff4d3f04ff99f6fe850b73d9582/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:02.122660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.133643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f26978a1-3bc6-4377-99c0-2e9cb4dbf3ed None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:02.135931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f26978a1-3bc6-4377-99c0-2e9cb4dbf3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.218621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 966/1934] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:02.218621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.218621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.218621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.235052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6717-cbe3-48c4-a4f7-8ea7e34fa6ca admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.244941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.245768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.246427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.247291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.248005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.248472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] MFA Rules not processed for user `c0c34ff4d3f04ff99f6fe850b73d9582`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:02.249667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.249793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.271356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 969/1935] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:02 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:02.274266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.283035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.377673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 967/1936] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:02 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:02.379230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.393117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b46373-9879-42c7-817a-298dcd244245 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.398720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.399808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.400321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.400710 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] PATH_INFO: `/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38/users/9b110ba60df542a3aa4a07a7fdc6c6f2/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.419161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bef89e3bdb4b40bdde6b57b1aeec38, user_id=9b110ba60df542a3aa4a07a7fdc6c6f2, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.419542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd528f-f680-4cd0-836a-c97b349a4f5d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.421889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.423751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.424984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.425357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.425702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.438734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.440343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.452127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 970/1937] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:02.453304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.454842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.493638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 968/1938] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:02 2021] PUT /identity/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38/users/9b110ba60df542a3aa4a07a7fdc6c6f2/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:02.499068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.521676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5600c8-d654-4598-85ef-c1d4d41e5413 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.621722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.622605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.622890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.623356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.650556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44db33-6a7e-4aa0-87ca-9a07921e1006 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.656924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.658000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.658297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.658609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.659568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.661445 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.674675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 969/1939] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:02 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:02.679153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.693161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f1b20-350f-4bdf-a7c9-2db2d9e9c24c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.700625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.701661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.702059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.710597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] PATH_INFO: `/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38/users/9b110ba60df542a3aa4a07a7fdc6c6f2/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.710597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bef89e3bdb4b40bdde6b57b1aeec38, user_id=9b110ba60df542a3aa4a07a7fdc6c6f2, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.710597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57a73b-4212-4de9-8edd-28b4b86f799d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.724277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 970/1940] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:02 2021] PUT /identity/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38/users/9b110ba60df542a3aa4a07a7fdc6c6f2/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:02.739277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.739619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.739904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.789629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] MFA Rules not processed for user `9b110ba60df542a3aa4a07a7fdc6c6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:02.791669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.796867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.811487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:02.825089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 971/1941] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:02 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:02.825999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.827384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.842867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19317-d94d-485f-86e0-baf749f9e424 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:02.955746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 971/1942] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:02 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:02.955746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:02.965017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:02.977981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:02.982541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:02.985621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:02.986845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] PATH_INFO: `/v3/users/d9c0769714ad447db8104868f6439a21` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:02.989051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c0769714ad447db8104868f6439a21)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:02.994156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:03.098298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ee62-60e7-4043-844b-6fe2e83035fb None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:03.104289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:03.105334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.105860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.106371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.108492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c0769714ad447db8104868f6439a21'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.110863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.118014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c0769714ad447db8104868f6439a21'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.119923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c0769714ad447db8104868f6439a21'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.163564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c0769714ad447db8104868f6439a21'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.165463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c0769714ad447db8104868f6439a21'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.189465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 972/1943] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:02 2021] DELETE /identity/v3/users/d9c0769714ad447db8104868f6439a21 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:03.194361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:03.196480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.202191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:03.205120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:03.220334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 972/1944] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:02 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:03.222356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:03.224938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.244131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ab72-ce1d-46b0-9fb1-640f1e01993a service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:03.379088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:03.380032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.380327 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.380601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] PATH_INFO: `/v3/projects/f81ac9c267a74ca1afaa5ef67c11049f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.384534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa953031-d2ae-42bc-bebf-548c70a8de2d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:03.388690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81ac9c267a74ca1afaa5ef67c11049f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:03.390779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:03.400106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:03.400834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.401407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.402294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.406423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.548473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81ac9c267a74ca1afaa5ef67c11049f', 'request_id': 'req-f0cb2026-5fdc-4158-8957-87c95e344eeb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.571401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81ac9c267a74ca1afaa5ef67c11049f', 'request_id': 'req-f0cb2026-5fdc-4158-8957-87c95e344eeb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.587969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81ac9c267a74ca1afaa5ef67c11049f', 'request_id': 'req-f0cb2026-5fdc-4158-8957-87c95e344eeb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.607501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:03.608523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d4d1-6020-49cc-868f-8dc81e170460 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:03.616455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] The token cache is being invalidate because project f81ac9c267a74ca1afaa5ef67c11049f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:03.616455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.618407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f0cb2026-5fdc-4158-8957-87c95e344eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.626965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 973/1945] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:03 2021] DELETE /identity/v3/projects/f81ac9c267a74ca1afaa5ef67c11049f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:03.629128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d585-22f6-41c2-8838-d6784aab421e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.629458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d585-22f6-41c2-8838-d6784aab421e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.629792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35d585-22f6-41c2-8838-d6784aab421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.651951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 973/1946] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:03 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:03.655158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.655457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.655732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.660521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 974/1947] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:59:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:59:03.660722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:03.663884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.681798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8d35d585-22f6-41c2-8838-d6784aab421e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:03.684882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8d35d585-22f6-41c2-8838-d6784aab421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.842469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cadc16-5bac-4887-a43f-70d0de9ab229 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:03.852835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:03.853739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.854169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.854305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] PATH_INFO: `/v3/users/c27a41e54ff2413abf222b2913780be1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.857398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27a41e54ff2413abf222b2913780be1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:03.861057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:03.905179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 974/1948] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:03.905179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:03.906975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:03.906975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:03.941641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:03.943117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27a41e54ff2413abf222b2913780be1'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.943498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:03.951297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27a41e54ff2413abf222b2913780be1'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.952810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27a41e54ff2413abf222b2913780be1'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.967671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27a41e54ff2413abf222b2913780be1'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:03.968820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27a41e54ff2413abf222b2913780be1'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.003540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 975/1949] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:03 2021] DELETE /identity/v3/users/c27a41e54ff2413abf222b2913780be1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:04.006521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.011537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.035767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 975/1950] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:59:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:04.044310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.047197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.074471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b58a61-2da0-43c5-a3e2-93aacd0abd39 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.141927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2e2-d52f-44a1-96a1-48160de77b2a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.147649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.154671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.154671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.154671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.154671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.188460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.189607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.190017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.190412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.211764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.213447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.234028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 976/1951] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:04.267547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.272763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.289881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 976/1952] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:04.447719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.450021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.473791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0bcd7-3e59-4d11-9fb3-ee591c674fff service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.494712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.495854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.496470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.497477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] PATH_INFO: `/v3/users/7a032a8aafaf42eca414ed7fee6e2c53` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.499684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a032a8aafaf42eca414ed7fee6e2c53)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.502103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.574322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a032a8aafaf42eca414ed7fee6e2c53'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.582366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a032a8aafaf42eca414ed7fee6e2c53'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.584184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a032a8aafaf42eca414ed7fee6e2c53'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.591673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.600158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.601758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a032a8aafaf42eca414ed7fee6e2c53'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.617848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ae9dd-10d7-4a23-9142-4bc8b1768352 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.624654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91d4902b-f6ff-43ed-be01-07476a6480d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a032a8aafaf42eca414ed7fee6e2c53'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.629235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.630011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.630284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.631960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] PATH_INFO: `/v3/projects/89a7ef8571314c7fbd7625fba73e3177` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.633359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a7ef8571314c7fbd7625fba73e3177)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.635457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 977/1953] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:04 2021] DELETE /identity/v3/users/7a032a8aafaf42eca414ed7fee6e2c53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:04.637079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.640864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.641253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.641674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.669082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:04.670654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.727841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a7ef8571314c7fbd7625fba73e3177', 'request_id': 'req-3badf529-7614-434e-a5c0-b896dc4f447e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.742303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a7ef8571314c7fbd7625fba73e3177', 'request_id': 'req-3badf529-7614-434e-a5c0-b896dc4f447e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.749643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a7ef8571314c7fbd7625fba73e3177', 'request_id': 'req-3badf529-7614-434e-a5c0-b896dc4f447e'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.755215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 978/1954] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:04.764774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] The token cache is being invalidate because project 89a7ef8571314c7fbd7625fba73e3177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:04.765064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.765863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3badf529-7614-434e-a5c0-b896dc4f447e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:04.772232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 977/1955] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:04 2021] DELETE /identity/v3/projects/89a7ef8571314c7fbd7625fba73e3177 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:04.772413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.773966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095125-920d-417f-8af3-2720adb8b67f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.774253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095125-920d-417f-8af3-2720adb8b67f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.774559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095125-920d-417f-8af3-2720adb8b67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.775885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.801334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-09095125-920d-417f-8af3-2720adb8b67f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:04.803057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-09095125-920d-417f-8af3-2720adb8b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.869135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ecce4-9578-4ff0-b103-8241f28739ff None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.892998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 978/1956] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:04.893897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095125-920d-417f-8af3-2720adb8b67f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:04.895563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-09095125-920d-417f-8af3-2720adb8b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.910533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095125-920d-417f-8af3-2720adb8b67f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:04.917570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.919407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.919686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.919991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] PATH_INFO: `/v3/projects/ef633082704a466ea178c4d5d67d780c` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.923883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef633082704a466ea178c4d5d67d780c)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.928184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.941094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:04.942348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.942814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:04.943300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:04.945794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:04.961481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:04.963216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907c00-e7be-4578-ad19-053fbfeccfa8 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:04.989495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 979/1957] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:04.989495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60989-71c3-430d-b8a3-f33d5db8cde4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:04.989495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60989-71c3-430d-b8a3-f33d5db8cde4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.003277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef633082704a466ea178c4d5d67d780c', 'request_id': 'req-d740a1d5-4ac3-430e-b302-b3c998c82c3a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.004060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60989-71c3-430d-b8a3-f33d5db8cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.017730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef633082704a466ea178c4d5d67d780c', 'request_id': 'req-d740a1d5-4ac3-430e-b302-b3c998c82c3a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.035138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef633082704a466ea178c4d5d67d780c', 'request_id': 'req-d740a1d5-4ac3-430e-b302-b3c998c82c3a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.038575 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3aa60989-71c3-430d-b8a3-f33d5db8cde4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:05.040443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3aa60989-71c3-430d-b8a3-f33d5db8cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.051778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] The token cache is being invalidate because project ef633082704a466ea178c4d5d67d780c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:05.052649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.053326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.055264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 979/1958] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:04 2021] DELETE /identity/v3/projects/ef633082704a466ea178c4d5d67d780c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:05.061298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.064716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.160784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740a1d5-4ac3-430e-b302-b3c998c82c3a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.166870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.167762 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.168091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.169114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] PATH_INFO: `/v3/users/68cc63fa5e25491696d0c6e384085e5f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.170444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cc63fa5e25491696d0c6e384085e5f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.173438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.173946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 980/1959] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:05.178145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.178582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.178954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.220847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:05.222194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.231204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 981/1960] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:05.232890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.252338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cc63fa5e25491696d0c6e384085e5f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.268968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cc63fa5e25491696d0c6e384085e5f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.269856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cc63fa5e25491696d0c6e384085e5f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.271718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0714ac-b2c3-4262-bea0-2c28619901ef None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.293057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.294393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.295026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.295616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.296324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cc63fa5e25491696d0c6e384085e5f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.297251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:05.297946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-99c71646-7c4a-4577-9800-a18d647a9f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cc63fa5e25491696d0c6e384085e5f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.298563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.311157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf72bd2-b80a-429b-9e08-0623de37fca1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.321289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 980/1961] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:05 2021] DELETE /identity/v3/users/68cc63fa5e25491696d0c6e384085e5f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:05.322973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.323423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.323687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.352374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 982/1962] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:05.354125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.354647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.355128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.362234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:05.363835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.399472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:05.400736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.507945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 983/1963] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:05.508748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.511667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 981/1964] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:05.516788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.519641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.534406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448448f0-fbff-4d45-9d6b-20ee0393ad44 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.541294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.542195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.542487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.542844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.544002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:05.544412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.546634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.547083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177c6f7-dd93-4069-8f42-0c2f6d7925e4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.575447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.576252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.576563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.576878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.577657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.579804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.585650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 982/1965] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:05.586988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.590321 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.638797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 984/1966] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:05.641119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.643449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.703213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344480-c2c1-4d93-8d60-bbf7b795ef13 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.745756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e127caa-a24c-4f0c-9ec2-0a05e5d714f4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.751021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.751922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.752202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.752477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] PATH_INFO: `/v3/projects/f35a0ace4798408eb324843d6b8986e4` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.753855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35a0ace4798408eb324843d6b8986e4)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.754666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.755456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.755808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.755899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.756258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.766434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.769147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.780716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 983/1967] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:05.781804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.793741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98cef0-fe25-4d12-9259-98b116fd56cc service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.811842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35a0ace4798408eb324843d6b8986e4', 'request_id': 'req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.824576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35a0ace4798408eb324843d6b8986e4', 'request_id': 'req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.831027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35a0ace4798408eb324843d6b8986e4', 'request_id': 'req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.845840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] The token cache is being invalidate because project f35a0ace4798408eb324843d6b8986e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:05.846203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.846980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:05.848757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 985/1968] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:05 2021] DELETE /identity/v3/projects/f35a0ace4798408eb324843d6b8986e4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:05.850144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.851862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.865915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.866625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.866918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.867184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.867914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.870188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:05.902747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 984/1969] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:05.902747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:05.905060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:05.939740 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd86b9-f1b7-4771-90ba-3c7b90dd7625 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.981062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69e885-463f-4678-8778-c1fbd605a828 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:05.988209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:05.989337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:05.989814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:05.990605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] PATH_INFO: `/v3/users/9b110ba60df542a3aa4a07a7fdc6c6f2` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:05.992097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b110ba60df542a3aa4a07a7fdc6c6f2)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:05.994247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.010542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.011094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.011479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.012016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.012836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.014898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.038092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 986/1970] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:05 2021] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:06.039134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.042769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.049008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b110ba60df542a3aa4a07a7fdc6c6f2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.055027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58f22f-6180-4d71-934b-59ba0d842ad4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.056406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b110ba60df542a3aa4a07a7fdc6c6f2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.057092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b110ba60df542a3aa4a07a7fdc6c6f2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.060498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.061364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.061814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.062083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.062882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.064862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.069335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b110ba60df542a3aa4a07a7fdc6c6f2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.070192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b110ba60df542a3aa4a07a7fdc6c6f2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.087735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 985/1971] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:05 2021] DELETE /identity/v3/users/9b110ba60df542a3aa4a07a7fdc6c6f2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.091159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.091159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.091356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 987/1972] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:06 2021] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:06.095717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.104530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.117665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0026-5aff-473d-ba4b-e10fb34c4df5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.194369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658544e-08e4-4795-b766-daa9dc211aa8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.199816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.200509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.200791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.201063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.201294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.201816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.202278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.202722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.203127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.203504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.204170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.206099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.214658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 986/1973] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:06.215732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.217502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.221969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 988/1974] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:06.222982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.233487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a20b7d-de34-4b44-8fad-c6cbd2d1cef3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.234310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb38e-ef46-4d92-8f32-a455a4c3a5d6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.239794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.240186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.240683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.240805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.240976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.241083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.241282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] PATH_INFO: `/v3/projects/a1509fc69a4d4ff782745b7bb2c12e64` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.241379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.242167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.242594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1509fc69a4d4ff782745b7bb2c12e64)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.243822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.244702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.274496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 989/1975] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:06.276117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.288836 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ddd80-355d-4d8f-9a47-9644e96ae4e7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.294153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.295047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.295328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.295615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.296599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.298351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.317611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 990/1976] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:06.317611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.328607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1509fc69a4d4ff782745b7bb2c12e64', 'request_id': 'req-202bf137-1114-4a55-bb48-f919635c971a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.330138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a53ab-40e8-4b37-ab74-6bcd1a2fbd4f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.343468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1509fc69a4d4ff782745b7bb2c12e64', 'request_id': 'req-202bf137-1114-4a55-bb48-f919635c971a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.378752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1509fc69a4d4ff782745b7bb2c12e64', 'request_id': 'req-202bf137-1114-4a55-bb48-f919635c971a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.396736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] The token cache is being invalidate because project a1509fc69a4d4ff782745b7bb2c12e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:06.397232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.398749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.402432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 987/1977] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:06 2021] DELETE /identity/v3/projects/a1509fc69a4d4ff782745b7bb2c12e64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.407118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.410883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.437409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.438329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.438985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.439264 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] PATH_INFO: `/v3/projects/896ff1e7ebfa4e979321993bcf175c70/users/a77b43f7b1de47208e30d595f7df94c1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.462706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896ff1e7ebfa4e979321993bcf175c70, user_id=a77b43f7b1de47208e30d595f7df94c1, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.465955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.504142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 991/1978] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:06 2021] PUT /identity/v3/projects/896ff1e7ebfa4e979321993bcf175c70/users/a77b43f7b1de47208e30d595f7df94c1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.504142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.507261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf137-1114-4a55-bb48-f919635c971a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.507843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.579732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.580765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.581127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.581569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] PATH_INFO: `/v3/projects/14f6becd549847119c7512b9b5587d4b/users/502005ad45f54eb8be4facc82d09535f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.591262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b882320-867f-43c0-a40d-06cc2d5b4da3 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.595847 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f6becd549847119c7512b9b5587d4b, user_id=502005ad45f54eb8be4facc82d09535f, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.597149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.598106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.598462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.598769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b553c-cd9f-4571-a921-b1142431c87e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.598863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] PATH_INFO: `/v3/users/89aaacbe174d4467883b7933fefeae17` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.600175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=89aaacbe174d4467883b7933fefeae17)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.602287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.623315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 988/1979] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:06 2021] PUT /identity/v3/projects/14f6becd549847119c7512b9b5587d4b/users/502005ad45f54eb8be4facc82d09535f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.623315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3317-1f60-4cbf-b00c-4ab095743129 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.623315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3317-1f60-4cbf-b00c-4ab095743129 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.623315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3317-1f60-4cbf-b00c-4ab095743129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.646930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cbde3317-1f60-4cbf-b00c-4ab095743129 None None] MFA Rules not processed for user `a77b43f7b1de47208e30d595f7df94c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:06.648817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cbde3317-1f60-4cbf-b00c-4ab095743129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.662776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89aaacbe174d4467883b7933fefeae17'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.670051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89aaacbe174d4467883b7933fefeae17'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.671827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89aaacbe174d4467883b7933fefeae17'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.680805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89aaacbe174d4467883b7933fefeae17'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.694055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89aaacbe174d4467883b7933fefeae17'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.700664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 992/1980] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:06 2021] DELETE /identity/v3/users/89aaacbe174d4467883b7933fefeae17 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.701769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.703050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.773993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 989/1981] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:06 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:06.775356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.775647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.780594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.799693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de4a73-a464-4f67-814b-e48ab392d93c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.805765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.806952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.807407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.807852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] PATH_INFO: `/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.810268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bef89e3bdb4b40bdde6b57b1aeec38)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.813246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:06.813496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] MFA Rules not processed for user `502005ad45f54eb8be4facc82d09535f`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:06.814740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.883559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bef89e3bdb4b40bdde6b57b1aeec38', 'request_id': 'req-496e6b9b-870c-459d-9fb3-7c88e0af67ae'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.895053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 990/1982] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:06.898686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.898803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bef89e3bdb4b40bdde6b57b1aeec38', 'request_id': 'req-496e6b9b-870c-459d-9fb3-7c88e0af67ae'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.898886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.909617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bef89e3bdb4b40bdde6b57b1aeec38', 'request_id': 'req-496e6b9b-870c-459d-9fb3-7c88e0af67ae'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.913343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93508a45-c4e2-4114-94a5-b9b44c462b85 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:06.937627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] The token cache is being invalidate because project 01bef89e3bdb4b40bdde6b57b1aeec38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:06.938189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.939135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:06.942354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 993/1983] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:06 2021] DELETE /identity/v3/projects/01bef89e3bdb4b40bdde6b57b1aeec38 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:06.943456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:06.949474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:06.984262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:06.985119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:06.985433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:06.985827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:06.987714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:06.989963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95c24-3a81-49a3-bd2f-5ff03df6fe89 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.023700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 991/1984] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:06 2021] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:07.024963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.025265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.025525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.033624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6b9b-870c-459d-9fb3-7c88e0af67ae admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.049716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:07.051375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.123568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.124209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.124497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.124775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.126236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.129494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d94e6-5c08-4315-8a93-e1ccf88f6fd2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.151348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 992/1985] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:07.151348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.154692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.183346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe0b1-2552-4284-b6a5-c73c031bfd19 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.192627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.193379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.194124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.194412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.195528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.195826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 994/1986] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:06 2021] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:07.197513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.198749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.200779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.201265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.245120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:07.250776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 993/1987] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:07.251051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.252237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.254503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.273741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1583d9-8300-4fcc-b4a3-10c736753690 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.358562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.358562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.358562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.358562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] PATH_INFO: `/v3/projects/1bd98c25e57846b79bd6f5600b41981c` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.359002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd98c25e57846b79bd6f5600b41981c)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.362035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.385391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 995/1988] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:07.386536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.399826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6206-f71d-4be2-9b7e-7350c356b102 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.406363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.407422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.407796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.408629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.409048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.411311 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.453236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 996/1989] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/users => generated 288 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:07.454167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.460381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd98c25e57846b79bd6f5600b41981c', 'request_id': 'req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.468491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc045a8d-6ee7-4820-a07b-b86080cd1ccd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.479337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd98c25e57846b79bd6f5600b41981c', 'request_id': 'req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.488790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd98c25e57846b79bd6f5600b41981c', 'request_id': 'req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.503144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] The token cache is being invalidate because project 1bd98c25e57846b79bd6f5600b41981c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:07.503694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.504719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.507151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 994/1990] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:07 2021] DELETE /identity/v3/projects/1bd98c25e57846b79bd6f5600b41981c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:07.508301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.514767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.561130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.561868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.562161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.562443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.563392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.565062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.577358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 997/1991] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:07.578425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.583764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.600738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bc649-dd55-4d1b-9f23-69893053da13 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.606912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b1e1-b2f8-4def-82e3-d48dc7ef2ea5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.607652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.608527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.608963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.609282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.609983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.612038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.612181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de69bdf-d155-482a-8c08-d25f88d07058 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.612707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.613016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.613293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.614035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:07.614673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.615959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.625734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 998/1992] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:07.625922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.626181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.626457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.638808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 995/1993] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:07.639928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.642397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.657199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:07.658553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.667044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd427695-1b5c-4fcf-9898-0b65f6d63758 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.673874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 999/1994] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:07.675257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.689955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.690103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.691128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.691476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.691825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] PATH_INFO: `/v3/projects/054ac80a2e344ffd844faaa22e95c259/users/387d8147776348329c37af000a4ff443/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.702079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5848be-e8e8-4ece-b865-182d6eedf632 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.706729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.707607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.707878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.708143 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] PATH_INFO: `/v3/users/9e837071d7b54fc69410f5bd9e60fb52` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.709945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e837071d7b54fc69410f5bd9e60fb52)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.711830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054ac80a2e344ffd844faaa22e95c259, user_id=387d8147776348329c37af000a4ff443, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.712121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.714770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.732586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 996/1995] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:07 2021] PUT /identity/v3/projects/054ac80a2e344ffd844faaa22e95c259/users/387d8147776348329c37af000a4ff443/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:07.736314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.763802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e837071d7b54fc69410f5bd9e60fb52'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.780621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e837071d7b54fc69410f5bd9e60fb52'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.782267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e837071d7b54fc69410f5bd9e60fb52'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.794440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e837071d7b54fc69410f5bd9e60fb52'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.808330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e837071d7b54fc69410f5bd9e60fb52'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:07.811889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6d36b-4d66-4c06-b818-768896b7f285 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.817298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.817976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.818304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.818606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.819380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.819748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1000/1996] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:07 2021] DELETE /identity/v3/users/9e837071d7b54fc69410f5bd9e60fb52 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:07.820576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.821232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416cf2e-f928-4680-8d58-1c26efe10ab4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.822007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.835446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 997/1997] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:07.835446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.835446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.835446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.855367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:07.856655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.897953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a40f5f-b835-4a0d-97fc-679387dd9882 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.903789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.904605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.904983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.905703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.906123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.908149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc374b8-405f-468f-a54b-54750370618d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.916860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 998/1998] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:07.917833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.920161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.933800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25278b25-a603-4ac1-9b3a-8e05202f75b2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:07.939041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:07.939797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.940144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.940477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.941615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:07.943416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:07.944218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1001/1999] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:07.945609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:07.945897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:07.946217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:07.955650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 999/2000] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:07.956747 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:07.964345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.967678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:07.969361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:07.977981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc827090-1918-4426-a13c-e097dd4e39ca admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.040088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1002/2001] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:08.041013 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.050601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b219c-716e-44bb-ae6e-b977f870e1df None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.051418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.052427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.052776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.053048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] PATH_INFO: `/v3/projects/d8988e9e88e7455d8777e272496aaa7a/users/b8f970cad35d4f729eaa6846fa4b9088/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.055455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.056149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.056426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.057090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.057431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:08.057737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.059448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.071844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1003/2002] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:08.073987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8988e9e88e7455d8777e272496aaa7a, user_id=b8f970cad35d4f729eaa6846fa4b9088, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.076120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.077255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.086126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226203-cece-49f2-9c40-a2e1df4ff845 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.090811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.091473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.091753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.092024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.092834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.093534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1000/2003] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:07 2021] PUT /identity/v3/projects/d8988e9e88e7455d8777e272496aaa7a/users/b8f970cad35d4f729eaa6846fa4b9088/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:08.094084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.095928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.118297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1004/2004] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/users => generated 281 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:08.119269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.123248 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.160900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65c11-4a71-414d-9b97-87b187e2ee07 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.166291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.167581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.167863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.168335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] PATH_INFO: `/v3/projects/054ac80a2e344ffd844faaa22e95c259/users/387d8147776348329c37af000a4ff443/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.170576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054ac80a2e344ffd844faaa22e95c259, user_id=387d8147776348329c37af000a4ff443, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.173252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.181696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e54cf-7731-43ff-895c-21c7a5a87aac admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.184139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1001/2005] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:08 2021] PUT /identity/v3/projects/054ac80a2e344ffd844faaa22e95c259/users/387d8147776348329c37af000a4ff443/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:08.185022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.237001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.237663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.237946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.238229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.255134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e24a5-34de-456d-a022-16fdd650a0e7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.260580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.261372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.261926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.262274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.263253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.265280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3fd8-a7d1-4365-9757-f588797ab74e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.295711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1002/2006] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:08.295711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.295711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.295711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.306694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.308223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.318752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1005/2007] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:08.319772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.326367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] MFA Rules not processed for user `b8f970cad35d4f729eaa6846fa4b9088`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:08.327696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.329931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b5d10-5f2b-421a-a3cb-20e7a18adff2 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.399099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.400089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.400372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.400648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.401688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.404231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a9f98-f776-482c-a16c-314a22316831 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.416113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1006/2008] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:08.417346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.417671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.418502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.431963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1003/2009] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:08.433105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.451551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648ee1-c86b-4212-9416-d57f5f33c928 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.453409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] MFA Rules not processed for user `387d8147776348329c37af000a4ff443`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:08.454799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.461928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.463239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.464035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.464479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.465514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.469435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.500155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1004/2010] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/users => generated 288 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:08.500991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.517710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e289-dbc1-4fb1-8210-474d06fbeb11 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.528941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.529631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.529907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.530181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.530952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.532701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.544703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1005/2011] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:08.545768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.560312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e68a-a3cf-47eb-80b1-13df02de126c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.566301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.567050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.567481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.567727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.568681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.571894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.572227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1007/2012] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:08.578800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.591126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fbfd-828d-4fd1-85b5-eb3711ddd8e0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.596571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.597252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.597533 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.598288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.599083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.600702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.612887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1008/2013] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:08.614112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.621342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1006/2014] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:08.622782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.626716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a066e-65c6-4c9b-bf06-56f5e8a177ec admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.627051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.706720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123998-142e-44c3-ba9f-96a2d85cf23c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.711796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.713333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.713932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.714345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.721465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.722921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.722921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.722921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] PATH_INFO: `/v3/projects/c92185cca2f94ba2a737f1f535730b63/users/7feecd13de8348cdbe21ea41d3a30d07/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.740503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92185cca2f94ba2a737f1f535730b63, user_id=7feecd13de8348cdbe21ea41d3a30d07, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.742595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.761239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1009/2015] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:08 2021] PUT /identity/v3/projects/c92185cca2f94ba2a737f1f535730b63/users/7feecd13de8348cdbe21ea41d3a30d07/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:08.762308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.788934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.791087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.800751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1007/2016] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:08.801576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.812618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b255a52-2b30-4596-a38b-ae5e0bb61e85 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.860840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17bfc4-8caa-4b39-b316-f212a140c808 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.869525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.870360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.871211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.873113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.876713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.880712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.896913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1010/2017] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:08 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:08.898017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:08.900621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.902367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.903392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.903637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.903932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.904661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.906614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea53ae-571c-430f-9971-f16e1cbd31b6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.914166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397e59-fb6e-4222-94e6-e312de689e61 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:08.923294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:08.924383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.924702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.925043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] PATH_INFO: `/v3/projects/6fd92e45bdad47c6aab865d065ef9037` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.926495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd92e45bdad47c6aab865d065ef9037)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:08.929044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:08.931190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1008/2018] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:08.932676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:08.933749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:08.934250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:08.962621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] MFA Rules not processed for user `7feecd13de8348cdbe21ea41d3a30d07`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:08.963837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:08.991897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd92e45bdad47c6aab865d065ef9037', 'request_id': 'req-ef33c42f-d738-44c6-b52a-96d1fd73c4be'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.001485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd92e45bdad47c6aab865d065ef9037', 'request_id': 'req-ef33c42f-d738-44c6-b52a-96d1fd73c4be'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.007215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd92e45bdad47c6aab865d065ef9037', 'request_id': 'req-ef33c42f-d738-44c6-b52a-96d1fd73c4be'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.019542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] The token cache is being invalidate because project 6fd92e45bdad47c6aab865d065ef9037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:09.020230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.020951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.022817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1011/2019] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:08 2021] DELETE /identity/v3/projects/6fd92e45bdad47c6aab865d065ef9037 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.023540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.024812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.035624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1009/2020] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:08 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:09.040138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.042571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.068427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d21c4-0797-4313-8534-3c62c3c26972 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.098438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c42f-d738-44c6-b52a-96d1fd73c4be admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.102154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.102839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.103126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.103397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.105466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.130724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.131864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.132203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.132487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] PATH_INFO: `/v3/projects/70f02c131f4d43cc97df4a637b64010d/users/53f2f55e6fa54f32a5b3243dd2f8592f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.149428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f02c131f4d43cc97df4a637b64010d, user_id=53f2f55e6fa54f32a5b3243dd2f8592f, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.152296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.167024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1010/2021] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:09 2021] PUT /identity/v3/projects/70f02c131f4d43cc97df4a637b64010d/users/53f2f55e6fa54f32a5b3243dd2f8592f/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.168005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.169571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.176142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.177861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.190799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1012/2022] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:09 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:09.193015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.196560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.216548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f53a4-a9ed-403c-8f01-e88bb69c6bde service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.262449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c22-74a7-4f82-83d8-5e3bdb386fc0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.269406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.270438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.270909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.271205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.272125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.273998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.283929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.284861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.285188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.285471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] PATH_INFO: `/v3/users/c0c34ff4d3f04ff99f6fe850b73d9582` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.286754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c34ff4d3f04ff99f6fe850b73d9582)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.289355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1011/2023] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:09.289513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.291636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.293568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.391571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf606c-6e38-4239-93bd-e080b04a422b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.392170 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c34ff4d3f04ff99f6fe850b73d9582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.396322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.396987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.397291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.397549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.404099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c34ff4d3f04ff99f6fe850b73d9582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.405149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c34ff4d3f04ff99f6fe850b73d9582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.413966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c34ff4d3f04ff99f6fe850b73d9582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.435792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ccd86a4d-3b94-49b7-8711-3b935c1df27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c34ff4d3f04ff99f6fe850b73d9582'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.448389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1013/2024] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:09 2021] DELETE /identity/v3/users/c0c34ff4d3f04ff99f6fe850b73d9582 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.450251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.450662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.451114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.483242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] MFA Rules not processed for user `53f2f55e6fa54f32a5b3243dd2f8592f`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:09.485117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.498353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.500619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.518429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1012/2025] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:09 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:09.519777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.535121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23a93-adb2-43aa-8c2b-724980ae6c6d service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.575382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1014/2026] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:09 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:09.576671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.578754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.621621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.623553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.623954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.624505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] PATH_INFO: `/v3/projects/d030191ce2b24eb8998d24645d8121d8/users/b3420ab605c84d2396d6bb807e22f8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.656387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d030191ce2b24eb8998d24645d8121d8, user_id=b3420ab605c84d2396d6bb807e22f8db, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.660614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.662179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb61ac7-2c2f-438f-b44a-c5efe685019c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.669782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.670942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.671364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.671711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] PATH_INFO: `/v3/users/a77b43f7b1de47208e30d595f7df94c1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.673106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77b43f7b1de47208e30d595f7df94c1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.675268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.682992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1013/2027] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:09 2021] PUT /identity/v3/projects/d030191ce2b24eb8998d24645d8121d8/users/b3420ab605c84d2396d6bb807e22f8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.683496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.685314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.759854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77b43f7b1de47208e30d595f7df94c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.770950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77b43f7b1de47208e30d595f7df94c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.772014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77b43f7b1de47208e30d595f7df94c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.794160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77b43f7b1de47208e30d595f7df94c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.804588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb7625-e78d-4839-8449-fd5cee8bd35a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.813683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.814874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.815225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.815608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] PATH_INFO: `/v3/users/7feecd13de8348cdbe21ea41d3a30d07` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.819071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feecd13de8348cdbe21ea41d3a30d07)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:09.819816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77b43f7b1de47208e30d595f7df94c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.821213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:09.827399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1015/2028] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:09 2021] DELETE /identity/v3/users/a77b43f7b1de47208e30d595f7df94c1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.828103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.831444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.909046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feecd13de8348cdbe21ea41d3a30d07'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.917784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feecd13de8348cdbe21ea41d3a30d07'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.919228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feecd13de8348cdbe21ea41d3a30d07'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.919576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e6d35-0f01-4fe7-a08d-0fccafe5fbcf admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:09.923657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:09.924394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:09.924741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:09.925078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:09.928009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:09.938169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feecd13de8348cdbe21ea41d3a30d07'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.939528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feecd13de8348cdbe21ea41d3a30d07'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:09.979395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1014/2029] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:09 2021] DELETE /identity/v3/users/7feecd13de8348cdbe21ea41d3a30d07 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:09.979395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:09.983284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.018481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.020228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2eeb11-b7bb-4bbb-aab7-5eb1f8a41744 service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.040057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1016/2030] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:10.045790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.046080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.047789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.079039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:10.080240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.092638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1017/2031] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:10.093543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.094981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.101325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655304a-9186-43d9-909f-99fd9f221a85 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.108876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace4182-950b-4a9e-90b4-8d070648486c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.114800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.115491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.115774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.117815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.118696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.122037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8cf2d-64b5-4536-a40e-fa3d4787de98 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.123478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.124554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.124838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.125113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] PATH_INFO: `/v3/projects/9e409bec8f45490c82be8aef4b6ef74a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.127800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e409bec8f45490c82be8aef4b6ef74a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.131343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.151729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1015/2032] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:10.154375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.154820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.155790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.185343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:10.187164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.196812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1016/2033] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:10.197814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.199279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.211186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e409bec8f45490c82be8aef4b6ef74a', 'request_id': 'req-37909a97-119c-4359-b834-9c7c52988c1d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:10.224983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e409bec8f45490c82be8aef4b6ef74a', 'request_id': 'req-37909a97-119c-4359-b834-9c7c52988c1d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:10.244963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e409bec8f45490c82be8aef4b6ef74a', 'request_id': 'req-37909a97-119c-4359-b834-9c7c52988c1d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:10.265756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcdab1-0389-4969-ada7-85db9c088552 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.266142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] The token cache is being invalidate because project 9e409bec8f45490c82be8aef4b6ef74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:10.266654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:10.268251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:10.274317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1018/2034] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:10 2021] DELETE /identity/v3/projects/9e409bec8f45490c82be8aef4b6ef74a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:10.286168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.288594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.370544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.371388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.371713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.372116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.377995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.383626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37909a97-119c-4359-b834-9c7c52988c1d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.388687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.389599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.390718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.390718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] PATH_INFO: `/v3/projects/d030191ce2b24eb8998d24645d8121d8/users/b3420ab605c84d2396d6bb807e22f8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.392262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d030191ce2b24eb8998d24645d8121d8, user_id=b3420ab605c84d2396d6bb807e22f8db, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.396585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.410899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.412354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5a9d-e753-4462-b71c-517cad6857cf service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.414502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1019/2035] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:10 2021] PUT /identity/v3/projects/d030191ce2b24eb8998d24645d8121d8/users/b3420ab605c84d2396d6bb807e22f8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:10.415448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.425323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.435788 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1017/2036] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:10.437164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e1e1-e348-4d12-ad10-982f7b256b75 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.437444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e1e1-e348-4d12-ad10-982f7b256b75 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.437772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e1e1-e348-4d12-ad10-982f7b256b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.460617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2616e1e1-e348-4d12-ad10-982f7b256b75 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:10.461925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2616e1e1-e348-4d12-ad10-982f7b256b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.610722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e29ed-6d09-4462-8334-e89955d6793e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.622041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1018/2037] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:10.622245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.622245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.622245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.622245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.627791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.629295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.629564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.629853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.653326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.656034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd033d2-a526-4bf2-b0fe-5e438da22077 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.678973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] MFA Rules not processed for user `b3420ab605c84d2396d6bb807e22f8db`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:10.681152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.688046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1020/2038] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:10.691462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.691652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.694100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.741460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:10.744647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.776810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1021/2039] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:10.784697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.801519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1019/2040] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:10.808452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a33ca-43db-4560-bcc0-1b8bc1d04a75 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.823711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.824479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.824767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.825005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.825752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:10.826049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.827705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.862610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.864049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:10.874226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1022/2041] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:10.877726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:10.891814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980efd7e-826e-4a09-88cd-ebc377915e93 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:10.897621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:10.898348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:10.898801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:10.899242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:10.900015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:10.901931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:10.947732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1023/2042] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:10.953845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.005112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a9c09-ab47-4cb3-8937-de5498e65a0c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.062894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.063450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80928b43-daf1-4c38-aa5d-9566a71ed3ce admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.063556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.063885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.064168 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.066020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.068490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.069346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.069799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.070198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.071077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.073002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.098627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1024/2043] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:10 2021] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:11.098627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.100775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.117012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce639260-a400-4667-9ac2-eaa644e0abfb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.124995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.127427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.129179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.130122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.130812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.135430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] PATH_INFO: `/v3/projects/896ff1e7ebfa4e979321993bcf175c70` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.137532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] RBAC: Authorizing `identity:delete_project(project_id=896ff1e7ebfa4e979321993bcf175c70)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.139562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.146686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1020/2044] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:11.148048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.184962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3abf3-fe37-4ee1-882c-f10c46c0e5d9 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.198207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.199344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.200503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.200748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.201639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.203579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.211334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896ff1e7ebfa4e979321993bcf175c70', 'request_id': 'req-68989c84-6b77-4077-b60c-b5e175b7475b'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.221909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1021/2045] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:11 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:11.221909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.222185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896ff1e7ebfa4e979321993bcf175c70', 'request_id': 'req-68989c84-6b77-4077-b60c-b5e175b7475b'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.222266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.226424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896ff1e7ebfa4e979321993bcf175c70', 'request_id': 'req-68989c84-6b77-4077-b60c-b5e175b7475b'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.238369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25df93-9ab2-4079-b967-ae6c752d3a8d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.242041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] The token cache is being invalidate because project 896ff1e7ebfa4e979321993bcf175c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:11.242321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.243145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.245045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1025/2046] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:11 2021] DELETE /identity/v3/projects/896ff1e7ebfa4e979321993bcf175c70 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:11.246220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.248051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.310794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.311742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.312017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.312286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] PATH_INFO: `/v3/projects/c92185cca2f94ba2a737f1f535730b63` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.313525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92185cca2f94ba2a737f1f535730b63)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.315545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.323783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68989c84-6b77-4077-b60c-b5e175b7475b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.329707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.330553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.330783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.331058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.331984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.333825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.346749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1026/2047] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:11 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:11.347688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.363669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.377393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dae6b-62ba-4901-b75b-8e76019f4619 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.393978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92185cca2f94ba2a737f1f535730b63', 'request_id': 'req-552527e6-2421-47a3-b39a-79985ca9c17f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.407006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92185cca2f94ba2a737f1f535730b63', 'request_id': 'req-552527e6-2421-47a3-b39a-79985ca9c17f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.413993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92185cca2f94ba2a737f1f535730b63', 'request_id': 'req-552527e6-2421-47a3-b39a-79985ca9c17f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.434635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] The token cache is being invalidate because project c92185cca2f94ba2a737f1f535730b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:11.435088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.436095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.439073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1022/2048] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:11 2021] DELETE /identity/v3/projects/c92185cca2f94ba2a737f1f535730b63 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:11.440410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.441885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.464130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.465511 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.465942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.466405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] PATH_INFO: `/v3/users/387d8147776348329c37af000a4ff443` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.473510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] RBAC: Authorizing `identity:delete_user(user_id=387d8147776348329c37af000a4ff443)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.475597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.565843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552527e6-2421-47a3-b39a-79985ca9c17f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.569731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387d8147776348329c37af000a4ff443'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.571604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.572881 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.573157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.573468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] PATH_INFO: `/v3/projects/61b6121f390644e3bb4c72958c64877f/users/05e076e94cde440787d4445798024379/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.580648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387d8147776348329c37af000a4ff443'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.582141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387d8147776348329c37af000a4ff443'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.595225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387d8147776348329c37af000a4ff443'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.598628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b6121f390644e3bb4c72958c64877f, user_id=05e076e94cde440787d4445798024379, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.601609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba6e2-d270-4a56-a728-ea1d9ba9e862 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.613573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5f205c2f-fdd6-44ed-b940-0538cb34649b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387d8147776348329c37af000a4ff443'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:11.621607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1027/2049] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:11 2021] DELETE /identity/v3/users/387d8147776348329c37af000a4ff443 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:11.623136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f674-3bc7-465e-8fa2-3194f23907f6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.623733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f674-3bc7-465e-8fa2-3194f23907f6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.623733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9f674-3bc7-465e-8fa2-3194f23907f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.636357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1023/2050] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:11 2021] PUT /identity/v3/projects/61b6121f390644e3bb4c72958c64877f/users/05e076e94cde440787d4445798024379/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:11.645490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-53b9f674-3bc7-465e-8fa2-3194f23907f6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:11.647023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-53b9f674-3bc7-465e-8fa2-3194f23907f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.648264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.649104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.649104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.691478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] MFA Rules not processed for user `05e076e94cde440787d4445798024379`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:11.693132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.746654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1028/2051] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:11.754578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.755121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.755238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.775222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1024/2052] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:11.779876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.781465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.794862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b2bd-a737-4faf-a82b-4c1b502afc6b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.795433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:11.796643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:11.799648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.800686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.800686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.800931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.801545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.803487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.805608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1029/2053] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:11.809814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.819145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2aec2-bc40-4832-941d-1e2e30093f94 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.824783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.825464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.825806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.826078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.826924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:11.827230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.828964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.837541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1025/2054] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:11.838798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.846089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1030/2055] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:11.848584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.860126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2bb9-56fd-4732-8358-68f0663b10c2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.923803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.924559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.924746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.925029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.928333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbf18-622d-46d8-9e03-5c5076851ff1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:11.930582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.932602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.946736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:11.947502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:11.947809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:11.948104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:11.948839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:11.951697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:11.970254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1031/2056] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:11.975906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.977793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1026/2057] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:11.978795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:11.989784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd85d-4e85-4399-8c72-f87cd07a1b08 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.055211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.055992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.056173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.056455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.057211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.059562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.061047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c484-d48d-48b0-a188-d582aab61b70 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.067739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.068551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.068955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.069379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.070444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.071193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1027/2058] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:11 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:12.072045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.074043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.074260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.089687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd5b0a-6d7c-4044-8d2d-1cdeabcdb308 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.095835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.096725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.097005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.097413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] PATH_INFO: `/v3/projects/054ac80a2e344ffd844faaa22e95c259` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.097518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1032/2059] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:11 2021] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:12.098370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.101947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054ac80a2e344ffd844faaa22e95c259)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.103936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.109188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89759a-e428-4fd1-a060-e2b9a61a8e1b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.114461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.115400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.115673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.115940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] PATH_INFO: `/v3/projects/d4d08634543f4ee3a6d4dd3291302c32/users/c767fa10a6364fba9f5762aa7f8260ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.133430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d08634543f4ee3a6d4dd3291302c32, user_id=c767fa10a6364fba9f5762aa7f8260ed, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.136480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.152806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1033/2060] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:12 2021] PUT /identity/v3/projects/d4d08634543f4ee3a6d4dd3291302c32/users/c767fa10a6364fba9f5762aa7f8260ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:12.154171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.157258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054ac80a2e344ffd844faaa22e95c259', 'request_id': 'req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:12.166274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054ac80a2e344ffd844faaa22e95c259', 'request_id': 'req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:12.172944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054ac80a2e344ffd844faaa22e95c259', 'request_id': 'req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:12.184611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] The token cache is being invalidate because project 054ac80a2e344ffd844faaa22e95c259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:12.184896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:12.185563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:12.187325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1028/2061] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:12 2021] DELETE /identity/v3/projects/054ac80a2e344ffd844faaa22e95c259 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:12.191426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.193042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.224002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5049b71-e0f2-4576-bcf9-4c9283170d9a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.228786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.229452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.229734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.230011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.231054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.232581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71ebd7-93ec-461b-ab77-a7943207e8e8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.242695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1034/2062] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:12.244001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.244298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.244578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.256791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46b50-0e6b-4403-9c7c-8b0bb00c7bb4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.263177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.263776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:12.263890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.264128 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.264402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.264993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.265193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.266853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.273040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1035/2063] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:12.273811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.277300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1029/2064] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:12.281302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.282659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.291470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f94e0-d778-46a9-af3c-cfb80258ec01 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.294764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa043c-5e6f-44ba-9438-df5dc9f1a705 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.297171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.298088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.298396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.298703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] PATH_INFO: `/v3/projects/d4d08634543f4ee3a6d4dd3291302c32/users/c767fa10a6364fba9f5762aa7f8260ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.299431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.300089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.300369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.300641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.300728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d08634543f4ee3a6d4dd3291302c32, user_id=c767fa10a6364fba9f5762aa7f8260ed, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.301376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.303110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd908c-facc-4c4e-80f1-92cc43d3280c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.303438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.313115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1036/2065] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:12.314244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1030/2066] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:12 2021] PUT /identity/v3/projects/d4d08634543f4ee3a6d4dd3291302c32/users/c767fa10a6364fba9f5762aa7f8260ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:12.317155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.318911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d0ab-3ec0-477f-8339-bc77d08a7165 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.319294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d0ab-3ec0-477f-8339-bc77d08a7165 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.319769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8d0ab-3ec0-477f-8339-bc77d08a7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.339076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-42f8d0ab-3ec0-477f-8339-bc77d08a7165 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:12.340389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-42f8d0ab-3ec0-477f-8339-bc77d08a7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.382603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769027b2-11d3-446c-baef-5043ed1070c9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.388253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.389146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.389424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.389697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] PATH_INFO: `/v3/projects/4c05f8232ea54ec0b4ba4b6541b3f2bd/users/423d96acc7624c9d9e4cdcfa13945f13/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.408005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1037/2067] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:12.409704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6197d2-639a-4b8c-90ab-bdf14dcbb251 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.409993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6197d2-639a-4b8c-90ab-bdf14dcbb251 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.410270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6197d2-639a-4b8c-90ab-bdf14dcbb251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.412731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c05f8232ea54ec0b4ba4b6541b3f2bd, user_id=423d96acc7624c9d9e4cdcfa13945f13, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.415908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.429928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1031/2068] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:12 2021] PUT /identity/v3/projects/4c05f8232ea54ec0b4ba4b6541b3f2bd/users/423d96acc7624c9d9e4cdcfa13945f13/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:12.438883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.439002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fd6197d2-639a-4b8c-90ab-bdf14dcbb251 None None] MFA Rules not processed for user `c767fa10a6364fba9f5762aa7f8260ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:12.439002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fd6197d2-639a-4b8c-90ab-bdf14dcbb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.501179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3470def-1835-406b-80d9-9f499c60c3ee admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.506189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.506893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.507170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.507439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.508228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:12.508531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.512136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1038/2069] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:12.512278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.512369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.512369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.512369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.522602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1032/2070] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:12.526994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.528931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.538880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] MFA Rules not processed for user `423d96acc7624c9d9e4cdcfa13945f13`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:12.540081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:12.589584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6701989-b209-43cd-9f9e-6d569adeaf61 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.594025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.594883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.595187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.595459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.605103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.606647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.611274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1039/2071] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:12.612187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.621222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1033/2072] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:12.622713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d3d98-7859-4914-87de-a946976c6b9b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.627476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.628506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.628506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.628668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.629343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.631303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.664099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.670560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1040/2073] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:12.670952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.676077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a017-4e50-4058-b8dc-412238bda370 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.745357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.746145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.746499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.746878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.751960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dddf58-5e50-4527-8608-040c2c6df9ca admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.757790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.758692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.758935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.759364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.760285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.762621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.798138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1041/2074] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:12.802177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.813875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2479-9b07-4349-9654-68bb398f6eab admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.822719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.823392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.823676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.823949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.824890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.826598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.831957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.833381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.838544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1042/2075] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:12.842544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.846015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1034/2076] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:12.857513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e320da-10fd-4dd4-ae8d-937bc6a1257b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.865549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.866899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.867452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.867977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.869998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.872151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2267-93ed-4171-bfbb-c7c0122ccdc1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.887212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1043/2077] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:12 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:12.888537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:12.899545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544951ed-c7cd-4585-b069-9b9eee6930a4 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:12.904806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:12.905700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.905981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.906254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] PATH_INFO: `/v3/projects/1bd99eda933744929721ab42451ef29c/users/f0cbc6ea4bac4da2ab0dc08089e2d60e/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.926081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd99eda933744929721ab42451ef29c, user_id=f0cbc6ea4bac4da2ab0dc08089e2d60e, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:12.929002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:12.944678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1035/2078] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:12 2021] PUT /identity/v3/projects/1bd99eda933744929721ab42451ef29c/users/f0cbc6ea4bac4da2ab0dc08089e2d60e/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:12.955271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:12.955527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:12.955672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:12.992315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] MFA Rules not processed for user `f0cbc6ea4bac4da2ab0dc08089e2d60e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:12.993540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.082805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1044/2079] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:12 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:13.087914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.088029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.171662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ced97-893d-4a49-8a55-1b92fbaa11d4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.172317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817b8d-803e-48f9-ae1d-7559c2784ba9 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.179426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.179609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.180459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.180577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.180774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.180994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.181197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] PATH_INFO: `/v3/users/05e076e94cde440787d4445798024379` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.181466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.182368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.182539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e076e94cde440787d4445798024379)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.185024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.185502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.230361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1036/2080] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:13 2021] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:13.231554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.235543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.274238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e076e94cde440787d4445798024379'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:13.283442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e076e94cde440787d4445798024379'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:13.284363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e076e94cde440787d4445798024379'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:13.294095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e076e94cde440787d4445798024379'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:13.314755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432d3a-138f-4456-ad3b-bc735a78e8d2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.317772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e076e94cde440787d4445798024379'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:13.318750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.319406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.319723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.320008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.322024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.325893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1045/2081] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:13 2021] DELETE /identity/v3/users/05e076e94cde440787d4445798024379 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:13.327923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.329105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.399246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.401099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148128-546d-46a6-a634-006a23746903 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.401218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64927d10-9447-4f48-b554-7d84b2847453 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.406385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.407087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.407363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.407632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.408340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.410256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.422671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1037/2082] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:13.425300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378003-5d47-478e-a775-dc99842a7496 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.425582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378003-5d47-478e-a775-dc99842a7496 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.425825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378003-5d47-478e-a775-dc99842a7496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.439343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1046/2083] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:13 2021] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:13.443047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.454034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a984c3-634f-4556-a250-c8c233021def admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.459110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.459780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.460051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.460319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.461060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.462239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-70378003-5d47-478e-a775-dc99842a7496 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:13.462757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.464338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-70378003-5d47-478e-a775-dc99842a7496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.474783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1047/2084] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:13.475187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1038/2085] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:13.479452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.485838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70378003-5d47-478e-a775-dc99842a7496 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.488402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-70378003-5d47-478e-a775-dc99842a7496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.496924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036667-71df-43b8-880c-a42afe1ba3c5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.504305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.505443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.505786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.506406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] PATH_INFO: `/v3/projects/cd1883115d494a77aea3ce23b0ac61a4/users/8ac0d432c03c4c84bc05909a9dca7273/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.525672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1883115d494a77aea3ce23b0ac61a4, user_id=8ac0d432c03c4c84bc05909a9dca7273, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.538339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.557740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70378003-5d47-478e-a775-dc99842a7496 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.565817 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1048/2086] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:13 2021] PUT /identity/v3/projects/cd1883115d494a77aea3ce23b0ac61a4/users/8ac0d432c03c4c84bc05909a9dca7273/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:13.577630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.661584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.662977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.663256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.663607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.687295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18e26-9d67-4be7-a16d-223dcc004da4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.692849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.693734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.694133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.694609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.695495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.697882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.714558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1049/2087] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:13 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:13.716491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.728629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c36f-2ec2-497c-8060-0db022dd7509 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:13.737807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:13.739216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.739681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.740071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] PATH_INFO: `/v3/projects/cd1883115d494a77aea3ce23b0ac61a4/users/8ac0d432c03c4c84bc05909a9dca7273/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.744515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1883115d494a77aea3ce23b0ac61a4, user_id=8ac0d432c03c4c84bc05909a9dca7273, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.747973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:13.749729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.749964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db7841-db5f-4c39-ad3b-57c10421cd5d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:13.765915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1050/2088] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:13 2021] PUT /identity/v3/projects/cd1883115d494a77aea3ce23b0ac61a4/users/8ac0d432c03c4c84bc05909a9dca7273/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:13.767231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1039/2089] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:13.776646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:13.776946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:13.777261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:13.813271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] MFA Rules not processed for user `8ac0d432c03c4c84bc05909a9dca7273`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:13.814827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.896009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1051/2090] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:13 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:13.913670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:13.915456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:13.984131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efda4d-e280-4e63-95a4-04ae636632fb service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.044487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.045493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.045656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.046306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.060437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.062294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.075511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1040/2091] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:13 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:14.238374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.244525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.247015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:14.273156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdcbfe-c9da-46a2-8b59-a8bcc8652afc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.279522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.280462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.280969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.281486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.283926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:14.375934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb62-c612-4b21-a101-62986818db76 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.384297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.385261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.385639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.385982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] PATH_INFO: `/v3/projects/61b6121f390644e3bb4c72958c64877f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.387601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b6121f390644e3bb4c72958c64877f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.388571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.389860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.390200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.402418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1052/2092] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:14 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:14.456003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b6121f390644e3bb4c72958c64877f', 'request_id': 'req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.466700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b6121f390644e3bb4c72958c64877f', 'request_id': 'req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.476065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b6121f390644e3bb4c72958c64877f', 'request_id': 'req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.497845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] The token cache is being invalidate because project 61b6121f390644e3bb4c72958c64877f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:14.498324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.499468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.505186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1041/2093] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:14 2021] DELETE /identity/v3/projects/61b6121f390644e3bb4c72958c64877f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:14.507292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.524348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439bfc-53bb-4099-aaff-15e52f157350 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.614078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.615657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.616021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.616558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] PATH_INFO: `/v3/users/c767fa10a6364fba9f5762aa7f8260ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.618673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c767fa10a6364fba9f5762aa7f8260ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.622465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.674187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.675853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:14.700644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c767fa10a6364fba9f5762aa7f8260ed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.707519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c767fa10a6364fba9f5762aa7f8260ed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.708139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c767fa10a6364fba9f5762aa7f8260ed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.717541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c767fa10a6364fba9f5762aa7f8260ed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.730705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c767fa10a6364fba9f5762aa7f8260ed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:14.737229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1053/2094] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:14 2021] DELETE /identity/v3/users/c767fa10a6364fba9f5762aa7f8260ed => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:14.741195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34ecbe-0466-4a4f-b9a8-928e51d7ff68 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.803687 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac0d432c03c4c84bc05909a9dca7273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1883115d494a77aea3ce23b0ac61a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.804679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.805057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.805430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.806302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:14.806835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.809570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.828339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1042/2095] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:14.829540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.831057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:14.844976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb4f90-ebca-49c1-8873-8b7d5e5c8953 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.849661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac0d432c03c4c84bc05909a9dca7273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1883115d494a77aea3ce23b0ac61a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.850370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.850693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.850991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.851712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.853614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.880781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1054/2096] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:14 2021] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:14.885074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:14.903681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa926-69d3-486c-9d46-d864ae8d0e6d tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:14.973992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac0d432c03c4c84bc05909a9dca7273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1883115d494a77aea3ce23b0ac61a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:14.974973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:14.975266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:14.975569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:14.976318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:14.976654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:14.978258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:14.993572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1043/2097] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:15.024549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.027393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.031751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.043816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81087b-dc49-4a47-a443-121a6f466aee tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.050406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac0d432c03c4c84bc05909a9dca7273', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1883115d494a77aea3ce23b0ac61a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.051339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.051693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.051856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] PATH_INFO: `/v3/projects/396d062233474ab2b269329ae8875317` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.053340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorizing `identity:delete_project(project_id=396d062233474ab2b269329ae8875317)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.055291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.103868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291508c-ab60-4b25-a8b8-377ea4254e55 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.106597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396d062233474ab2b269329ae8875317', 'request_id': 'req-20cdcb3f-df9b-467a-b474-bb105da5d319'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.116993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396d062233474ab2b269329ae8875317', 'request_id': 'req-20cdcb3f-df9b-467a-b474-bb105da5d319'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.124539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396d062233474ab2b269329ae8875317', 'request_id': 'req-20cdcb3f-df9b-467a-b474-bb105da5d319'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.138009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] The token cache is being invalidate because project 396d062233474ab2b269329ae8875317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:15.138615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.141879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-20cdcb3f-df9b-467a-b474-bb105da5d319 tempest-VolumeQuotaClassesTest-1568778407 tempest-VolumeQuotaClassesTest-1568778407-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.143823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1044/2098] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:15 2021] DELETE /identity/v3/projects/396d062233474ab2b269329ae8875317 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:15.174866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.176125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.176553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.176831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] PATH_INFO: `/v3/projects/d4d08634543f4ee3a6d4dd3291302c32` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.178659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d08634543f4ee3a6d4dd3291302c32)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.180381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.235769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d08634543f4ee3a6d4dd3291302c32', 'request_id': 'req-287b4a57-db87-4495-a3d7-b0ae180718af'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.245031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d08634543f4ee3a6d4dd3291302c32', 'request_id': 'req-287b4a57-db87-4495-a3d7-b0ae180718af'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.252771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d08634543f4ee3a6d4dd3291302c32', 'request_id': 'req-287b4a57-db87-4495-a3d7-b0ae180718af'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.266031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] The token cache is being invalidate because project d4d08634543f4ee3a6d4dd3291302c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:15.266416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.267182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.269081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1055/2099] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:15 2021] DELETE /identity/v3/projects/d4d08634543f4ee3a6d4dd3291302c32 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:15.274827 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8edf-0e35-4f6c-bedb-d031b98df793 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.275323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8edf-0e35-4f6c-bedb-d031b98df793 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.275541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba8edf-0e35-4f6c-bedb-d031b98df793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.300394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-a6ba8edf-0e35-4f6c-bedb-d031b98df793 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:15.301590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a6ba8edf-0e35-4f6c-bedb-d031b98df793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.360281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.362323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.378343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1045/2100] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:15.387402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.387768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.388142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.407444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:15.408641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.417036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1046/2101] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:15.421073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.430294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a619f03-dff0-4eb1-92ab-1990e5534c58 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.432242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b4a57-db87-4495-a3d7-b0ae180718af admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.435792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.436461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.436769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.437039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.437815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:15.438122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.438232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.439293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.439722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.439833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.440329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] PATH_INFO: `/v3/users/f0cbc6ea4bac4da2ab0dc08089e2d60e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.441725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cbc6ea4bac4da2ab0dc08089e2d60e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.443688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.456478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1047/2102] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:15.460737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.470957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8348a8-bac1-4f7b-83a3-06b3dbeca9c8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.476136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.477005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.477223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.477600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.478280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.480244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.500519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cbc6ea4bac4da2ab0dc08089e2d60e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.509256 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cbc6ea4bac4da2ab0dc08089e2d60e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.509946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cbc6ea4bac4da2ab0dc08089e2d60e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.520113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1048/2103] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:15.520339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cbc6ea4bac4da2ab0dc08089e2d60e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.521023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.523295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.538079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-6e9698f3-683a-4de3-ac8f-7f6052ce8b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cbc6ea4bac4da2ab0dc08089e2d60e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:15.546985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1056/2104] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:15 2021] DELETE /identity/v3/users/f0cbc6ea4bac4da2ab0dc08089e2d60e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:15.552509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.552952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.553289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.572693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:15.574023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.598710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05182662-1234-43ac-ae51-75de3b1c5ca6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.647318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1057/2105] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:15.657377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.659978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.665946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.665946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.665946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.665946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.666337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.666762 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.690823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1049/2106] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:15.694399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.704865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09cc9d-84da-400f-9d31-c2355e9bc1a4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.710145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.710850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.711296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.712317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.713065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.714726 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.725522 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1050/2107] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:15.726980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fdcc7-4cac-44ca-802e-af12fd2668f5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.729571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.730898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.731545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.731824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.732098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.739634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0540688-7cfa-4376-ba30-92772e899a11 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.741683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.743161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.744626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.745358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.745633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.745983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.746806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.748307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd365dd-9c99-424d-8d34-f430120832a3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.753307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1058/2108] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:15.758999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1051/2109] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:15.763860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:15.773735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82f2d8-7dc6-4db2-99d0-18311d6ef7e7 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:15.778913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:15.779929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.780648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.780648 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] PATH_INFO: `/v3/projects/8fed17232e534e6ca400bb15d66d3b63/users/eda98951822d454a9628357bcba409ad/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.797468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fed17232e534e6ca400bb15d66d3b63, user_id=eda98951822d454a9628357bcba409ad, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:15.800351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:15.815099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1059/2110] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:15 2021] PUT /identity/v3/projects/8fed17232e534e6ca400bb15d66d3b63/users/eda98951822d454a9628357bcba409ad/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:15.829327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:15.829714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:15.830140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:15.861022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] MFA Rules not processed for user `eda98951822d454a9628357bcba409ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:15.862645 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:15.948813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1052/2111] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:15.953077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.032701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c31118-389f-4911-8ecc-bab27e21a58d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.033352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.033988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.034269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.034566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.035273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.037219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.061295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.062773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.065036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1060/2112] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:15 2021] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:16.069058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.079869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28369ab5-860b-446d-bdab-84e36ba813fb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.130963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd142d-0dc9-4c09-8484-874b4916e43e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.135669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.136340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.136702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.136977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.137684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.137799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.138698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.138959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.139214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] PATH_INFO: `/v3/projects/1bd99eda933744929721ab42451ef29c` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.139796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.140387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd99eda933744929721ab42451ef29c)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.142300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.160894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1061/2113] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:16 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:16.165589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.176892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4fce-b8a1-4877-ad48-1877d537f692 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.189318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd99eda933744929721ab42451ef29c', 'request_id': 'req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.199264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd99eda933744929721ab42451ef29c', 'request_id': 'req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.205041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd99eda933744929721ab42451ef29c', 'request_id': 'req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.217469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] The token cache is being invalidate because project 1bd99eda933744929721ab42451ef29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:16.217754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.218426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.220502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1053/2114] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:16 2021] DELETE /identity/v3/projects/1bd99eda933744929721ab42451ef29c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:16.224231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.225845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.238309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.239210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.239635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.240014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.241024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.242768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.253464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1062/2115] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:16.257688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.259530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.271544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73577450-a75e-46e7-b162-358e2e379c90 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.276312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.277349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.277634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.277912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] PATH_INFO: `/v3/projects/b153e1b797be4fbb9384c949e1176bb2/users/0653868b6f7246ad9c40c6df9ddc2c72/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.290087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44f1e-ec5b-4868-a1db-5d6fd77ec6e0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.292846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b153e1b797be4fbb9384c949e1176bb2, user_id=0653868b6f7246ad9c40c6df9ddc2c72, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.294803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.295675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.295795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.295949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.296218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] PATH_INFO: `/v3/users/8ac0d432c03c4c84bc05909a9dca7273` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.297416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac0d432c03c4c84bc05909a9dca7273)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.299348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.309463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1063/2116] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:16 2021] PUT /identity/v3/projects/b153e1b797be4fbb9384c949e1176bb2/users/0653868b6f7246ad9c40c6df9ddc2c72/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:16.313471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.352355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac0d432c03c4c84bc05909a9dca7273'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.355115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac0d432c03c4c84bc05909a9dca7273'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.356206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac0d432c03c4c84bc05909a9dca7273'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.369766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac0d432c03c4c84bc05909a9dca7273'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.370463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac0d432c03c4c84bc05909a9dca7273'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.378936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5835eb-6182-4fb2-b8ba-bfac0622826c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.382730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1054/2117] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:16 2021] DELETE /identity/v3/users/8ac0d432c03c4c84bc05909a9dca7273 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:16.383547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.384210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.384491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.384761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.385504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.388249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114feb8-c81d-4b3b-a752-6b579d18a8c6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.401421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1064/2118] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:16 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:16.402723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.404155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.479270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d649628-c961-4c3a-ad88-08b2225290e0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.484725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.486120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.486893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.487293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] PATH_INFO: `/v3/projects/b153e1b797be4fbb9384c949e1176bb2/users/0653868b6f7246ad9c40c6df9ddc2c72/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.490346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b153e1b797be4fbb9384c949e1176bb2, user_id=0653868b6f7246ad9c40c6df9ddc2c72, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.493067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.506446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1055/2119] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:16 2021] PUT /identity/v3/projects/b153e1b797be4fbb9384c949e1176bb2/users/0653868b6f7246ad9c40c6df9ddc2c72/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:16.518240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.518590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.519085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.545772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] MFA Rules not processed for user `0653868b6f7246ad9c40c6df9ddc2c72`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:16.547078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.619456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1065/2120] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:16 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:16.629755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.631569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.723430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558d3b-1846-4b4f-bb52-6673dd61b41e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.729072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.730969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.731312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.731654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.733957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.793743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:16.795152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:16.799641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.801190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063881d8-bf54-497b-8cf3-94c3a8b1609a service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.813039 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1056/2121] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:16 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:16.874103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1c9d5-dcd7-4d1b-919f-972da97a2972 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:16.880724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:16.881602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.881875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.882139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] PATH_INFO: `/v3/projects/cd1883115d494a77aea3ce23b0ac61a4` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.886409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1883115d494a77aea3ce23b0ac61a4)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:16.888516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:16.938176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1883115d494a77aea3ce23b0ac61a4', 'request_id': 'req-153a4086-5c48-4ded-9c5f-cd4a5b47468c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.946345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1883115d494a77aea3ce23b0ac61a4', 'request_id': 'req-153a4086-5c48-4ded-9c5f-cd4a5b47468c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.953259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1883115d494a77aea3ce23b0ac61a4', 'request_id': 'req-153a4086-5c48-4ded-9c5f-cd4a5b47468c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.967613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] The token cache is being invalidate because project cd1883115d494a77aea3ce23b0ac61a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:16.967939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.968704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-153a4086-5c48-4ded-9c5f-cd4a5b47468c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:16.970639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1066/2122] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:16 2021] DELETE /identity/v3/projects/cd1883115d494a77aea3ce23b0ac61a4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:16.978207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:16.978560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:16.978884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:16.999970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:17.001167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:17.068376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1057/2123] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:17.070769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.071051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.071349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.091868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:17.093436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:17.103957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1067/2124] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:17.108207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.118852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199e246-cb51-4f64-b0a8-172f1869ccde None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.126732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.127397 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.127675 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.127940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.128677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:17.128978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.130612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.146133 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1058/2125] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:17.147229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.156732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002f46-3972-48b5-a95c-cc6f03abd2f6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.162492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.163180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.163457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.163736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.164466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.166383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.194108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1068/2126] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:17.198427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.208341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98014f-cfd5-49cf-bcb3-5dfbfbbbaf5c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.265080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.265754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.266036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.266310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.267058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.268954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.290170 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1059/2127] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:17.294379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.304590 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2cb81-5e1f-42f7-bbee-f7ef553ff04e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.309274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.309923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.310202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.310475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.311241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.312837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.323162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1069/2128] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:17.327572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.338213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12590e-eca5-4b40-9d2a-e735aea5faef admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.345096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.345777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.346054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.346294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.347085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.348700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c24bc-1554-484b-8598-727b8b736204 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.359720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1060/2129] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:17.364257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.375255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582b16-7be0-4724-8080-9646b185063b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.381044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.381932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.382213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.382486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] PATH_INFO: `/v3/projects/c9c8775318c94f4a9a268a911c6ff143/users/0399dea2f8374d9c888de647c0347a76/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.398032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c8775318c94f4a9a268a911c6ff143, user_id=0399dea2f8374d9c888de647c0347a76, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.400783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.416752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1070/2130] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:17 2021] PUT /identity/v3/projects/c9c8775318c94f4a9a268a911c6ff143/users/0399dea2f8374d9c888de647c0347a76/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:17.428235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.428641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.429043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.462176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] MFA Rules not processed for user `0399dea2f8374d9c888de647c0347a76`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:17.463395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:17.530781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1061/2131] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:17.535402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.600253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373244-464f-433d-8fe4-4f4e052f7351 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.606020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.606734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.607023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.607293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.607995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.609909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.639192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1071/2132] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:17.643310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.655467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224787-59c0-4e6e-8f0f-afde604ba1eb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.718618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.719303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.719665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.721374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.722098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.724051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.749428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1062/2133] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:17.753394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.764185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee5a98-b1b4-4df6-bb75-941717f90b8a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.769084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.769730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.770006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.770276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.771044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.773792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.784240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1072/2134] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:17.788416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.799286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8d9c8-3ffb-4024-9e81-28dbb7c9bc8b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.804643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.805537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.805818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.806094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] PATH_INFO: `/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff/users/f9ff575805ef40dd9660bacb205ea8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.821079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7203f092b3c4bc19b4c3e449bb657ff, user_id=f9ff575805ef40dd9660bacb205ea8db, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.823765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.837681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1063/2135] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:17 2021] PUT /identity/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff/users/f9ff575805ef40dd9660bacb205ea8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:17.841899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.852092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b120ab-a457-408c-bc32-92cf56e8391f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.910077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.910779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.911064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.911342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.912084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.913699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc085d-db59-420a-9c66-7356bc30fef0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.932341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1073/2136] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:17 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:17.933817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:17.944784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c0ccd-f16f-4961-a6f8-ebef9146d07c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:17.950127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:17.951031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.951307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.951574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] PATH_INFO: `/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff/users/f9ff575805ef40dd9660bacb205ea8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:17.953732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7203f092b3c4bc19b4c3e449bb657ff, user_id=f9ff575805ef40dd9660bacb205ea8db, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:17.956375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:17.967481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1064/2137] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:17 2021] PUT /identity/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff/users/f9ff575805ef40dd9660bacb205ea8db/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:17.978468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:17.978780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:17.979051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:18.007636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] MFA Rules not processed for user `f9ff575805ef40dd9660bacb205ea8db`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:18.009425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:18.084172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1074/2138] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:17 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:18.094189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:18.096228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:18.164849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153101-4d73-4928-ade8-1c1548f19827 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:18.169588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:18.170264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:18.170565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:18.170835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:18.181494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:18.182990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:18.192807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1065/2139] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:18 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:18.289062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:18.299527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebd235-f2fe-47f1-a78e-1d712675be8a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:18.303773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:18.304430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:18.304679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:18.304946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:18.366871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:18.368887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8b9d0-bf07-4652-85d3-dc7b26b33a24 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:18.379658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1075/2140] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:18 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:21.688615 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:21.691325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:21.760862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f21a7-e289-46c0-8a13-0850868cbce0 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:21.767540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:21.768680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:21.768680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:21.768941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] PATH_INFO: `/v3/users/502005ad45f54eb8be4facc82d09535f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:21.770130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502005ad45f54eb8be4facc82d09535f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:21.772251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:21.825578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502005ad45f54eb8be4facc82d09535f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:21.833262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502005ad45f54eb8be4facc82d09535f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:21.834218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502005ad45f54eb8be4facc82d09535f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:21.847183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502005ad45f54eb8be4facc82d09535f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:21.848152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502005ad45f54eb8be4facc82d09535f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:21.861998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1066/2141] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:21 2021] DELETE /identity/v3/users/502005ad45f54eb8be4facc82d09535f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:21.866820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:21.867392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:21.867392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:21.888063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:21.889282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:21.948310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1076/2142] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:21.958619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:21.960018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:22.016162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372727a-7999-4b09-a75b-70c5293764c3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:22.020338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:22.021406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.021406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.022441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.032781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:22.034216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:22.044530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1067/2143] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:22.322887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:22.324503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:22.339521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c86ac4-84f0-4c45-abee-63929d796866 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:22.345396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:22.347047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.347334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.347667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] PATH_INFO: `/v3/projects/14f6becd549847119c7512b9b5587d4b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.349212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f6becd549847119c7512b9b5587d4b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:22.351286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:22.401762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f6becd549847119c7512b9b5587d4b', 'request_id': 'req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.410023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f6becd549847119c7512b9b5587d4b', 'request_id': 'req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.415249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f6becd549847119c7512b9b5587d4b', 'request_id': 'req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.425943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] The token cache is being invalidate because project 14f6becd549847119c7512b9b5587d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:22.426230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.426853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.428365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1077/2144] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:22 2021] DELETE /identity/v3/projects/14f6becd549847119c7512b9b5587d4b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:22.432436 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:22.442384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b56e-fcc3-4c42-ae61-c19f111bfc31 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:22.500277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:22.501197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.501629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.501904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] PATH_INFO: `/v3/users/b8f970cad35d4f729eaa6846fa4b9088` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.503223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f970cad35d4f729eaa6846fa4b9088)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:22.505173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:22.552803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f970cad35d4f729eaa6846fa4b9088'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.559401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f970cad35d4f729eaa6846fa4b9088'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.560075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f970cad35d4f729eaa6846fa4b9088'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.571075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f970cad35d4f729eaa6846fa4b9088'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.571706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-38dcdb59-f72b-463f-9b02-c661c64c5800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f970cad35d4f729eaa6846fa4b9088'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.586016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1068/2145] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:22 2021] DELETE /identity/v3/users/b8f970cad35d4f729eaa6846fa4b9088 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:22.661578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:22.663168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:22.677228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a07d1-3189-4a59-9a0e-e9bd60fb6ebe admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:22.745769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:22.747120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.747477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.747651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] PATH_INFO: `/v3/users/eda98951822d454a9628357bcba409ad` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.748922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda98951822d454a9628357bcba409ad)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:22.751019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:22.810120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda98951822d454a9628357bcba409ad'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.817304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda98951822d454a9628357bcba409ad'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.818096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda98951822d454a9628357bcba409ad'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.827422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda98951822d454a9628357bcba409ad'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.842056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda98951822d454a9628357bcba409ad'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:22.850274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1078/2146] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:22 2021] DELETE /identity/v3/users/eda98951822d454a9628357bcba409ad => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:22.855026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.855529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.855681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.873953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:22.875483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:22.876030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:22.877298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:22.948545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31699f8d-8422-4f10-9bcc-f4c7d66a04a2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:22.956039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:22.956911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:22.957185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:22.957455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] PATH_INFO: `/v3/projects/d8988e9e88e7455d8777e272496aaa7a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:22.959813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8988e9e88e7455d8777e272496aaa7a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:22.961728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:22.973092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1069/2147] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:22.979762 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:22.981349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.013642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8988e9e88e7455d8777e272496aaa7a', 'request_id': 'req-2b5fe742-e9cd-446d-a880-8d92d102b747'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.022300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8988e9e88e7455d8777e272496aaa7a', 'request_id': 'req-2b5fe742-e9cd-446d-a880-8d92d102b747'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.030892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8988e9e88e7455d8777e272496aaa7a', 'request_id': 'req-2b5fe742-e9cd-446d-a880-8d92d102b747'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.059596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2220-a6a9-4aee-a9d6-19bd7fcaf170 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.060089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] The token cache is being invalidate because project d8988e9e88e7455d8777e272496aaa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:23.060398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.061193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.071258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1079/2148] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:22 2021] DELETE /identity/v3/projects/d8988e9e88e7455d8777e272496aaa7a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:23.075659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:23.082134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.152209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.153453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.153984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.154360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.155957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fe742-e9cd-446d-a880-8d92d102b747 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.156550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.161333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.162224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.162503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.162799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] PATH_INFO: `/v3/users/b3420ab605c84d2396d6bb807e22f8db` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.164011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3420ab605c84d2396d6bb807e22f8db)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.165922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.170688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.172878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.184638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1070/2149] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:23.213332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3420ab605c84d2396d6bb807e22f8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.221353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3420ab605c84d2396d6bb807e22f8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.222109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3420ab605c84d2396d6bb807e22f8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.230496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3420ab605c84d2396d6bb807e22f8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.243744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5c2f33a7-3aef-47c1-b890-a88d3a62a184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3420ab605c84d2396d6bb807e22f8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.249823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1080/2150] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:23 2021] DELETE /identity/v3/users/b3420ab605c84d2396d6bb807e22f8db => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:23.544710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:23.561914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c669-77d3-4f80-871f-7e67e285e0cf service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.649369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.650239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.650537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.650813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] PATH_INFO: `/v3/projects/d030191ce2b24eb8998d24645d8121d8` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.652018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d030191ce2b24eb8998d24645d8121d8)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.654136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.703613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd030191ce2b24eb8998d24645d8121d8', 'request_id': 'req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.712035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd030191ce2b24eb8998d24645d8121d8', 'request_id': 'req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.718705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd030191ce2b24eb8998d24645d8121d8', 'request_id': 'req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.730229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] The token cache is being invalidate because project d030191ce2b24eb8998d24645d8121d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:23.730471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.731195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-fa2e47f6-e0df-408b-9946-8dedb3b0b16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:23.732865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1071/2151] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:23 2021] DELETE /identity/v3/projects/d030191ce2b24eb8998d24645d8121d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:23.740468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.740955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.741298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.760144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:23.761392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.828369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1081/2152] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:23.835887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.836289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.836438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.856064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:23.858131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.867254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1072/2153] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:23.871227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:23.882314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ce5b-1b2d-4ca3-b386-fb9b47184c16 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.888270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.888952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.889234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.889506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.891040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:23.891433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.893652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.908509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1082/2154] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:23.913457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:23.936111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f555-0b5f-48ea-965f-b07ed06d3d7a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.943281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.944017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.944253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:23.944400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.944557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.945453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.946944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:23.947834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.966367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b29bf1-7486-4704-a0aa-f0c9efb1db52 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:23.973332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:23.974368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:23.974714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:23.975044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] PATH_INFO: `/v3/projects/8fed17232e534e6ca400bb15d66d3b63` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:23.978359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fed17232e534e6ca400bb15d66d3b63)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:23.980291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:23.989343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1073/2155] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:23 2021] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:23.993556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.032780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fed17232e534e6ca400bb15d66d3b63', 'request_id': 'req-b6fbad26-e126-4c96-85a0-0d04628119bd'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.041440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fed17232e534e6ca400bb15d66d3b63', 'request_id': 'req-b6fbad26-e126-4c96-85a0-0d04628119bd'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.047272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fed17232e534e6ca400bb15d66d3b63', 'request_id': 'req-b6fbad26-e126-4c96-85a0-0d04628119bd'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.060830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] The token cache is being invalidate because project 8fed17232e534e6ca400bb15d66d3b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:24.061113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.061755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.063678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1083/2156] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:23 2021] DELETE /identity/v3/projects/8fed17232e534e6ca400bb15d66d3b63 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:24.067210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.068832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.068974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818884-72e9-4bd1-b846-4865e20e4ede admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.136121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.137496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.137496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.137496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.138193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.140135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.144096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbad26-e126-4c96-85a0-0d04628119bd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.151133 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.152482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.153191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.153593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] PATH_INFO: `/v3/users/0653868b6f7246ad9c40c6df9ddc2c72` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.155724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0653868b6f7246ad9c40c6df9ddc2c72)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.157747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.165035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1074/2157] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:23 2021] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:24.169668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.171907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.184918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbc60-a893-4ba9-a21e-a68c2343d27b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.191254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.192050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.192528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.192941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.193757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.195815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.213592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1075/2158] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:24 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:24.214765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.221309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0653868b6f7246ad9c40c6df9ddc2c72'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.227782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339201e3-6187-489d-bc3a-69455a1ed7c2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.232988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0653868b6f7246ad9c40c6df9ddc2c72'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.233981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0653868b6f7246ad9c40c6df9ddc2c72'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.234107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.234865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.235217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.235563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.236865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.238582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.245701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0653868b6f7246ad9c40c6df9ddc2c72'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.252553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1076/2159] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:24 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:24.256629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.258428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.263233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-34d4f1df-b244-456f-985e-fa4571af6e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0653868b6f7246ad9c40c6df9ddc2c72'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.272090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1084/2160] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:24 2021] DELETE /identity/v3/users/0653868b6f7246ad9c40c6df9ddc2c72 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:24.279202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd5a9-1d63-4c5e-930c-ec2b61442f6d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.343037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.344089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.344493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.345164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] PATH_INFO: `/v3/projects/97f6a9f3b7564c02b297621eae94db69/users/cd9444a4c2224f3fbc8ff087f875efd9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.362882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f6a9f3b7564c02b297621eae94db69, user_id=cd9444a4c2224f3fbc8ff087f875efd9, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.365596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.379832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1077/2161] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:24 2021] PUT /identity/v3/projects/97f6a9f3b7564c02b297621eae94db69/users/cd9444a4c2224f3fbc8ff087f875efd9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:24.390880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.391265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.391600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.418165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] MFA Rules not processed for user `cd9444a4c2224f3fbc8ff087f875efd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:24.419500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.487838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1085/2162] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:24 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:24.505181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.507152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.568866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae9cff-b350-452d-9f26-308ef6c059f1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.572739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.573756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.573756 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.573977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.583565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.585067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe677-2fac-42a7-b4e9-e30c251cf391 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.594901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1078/2163] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:24 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:24.707751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.709905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.728181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f95cd-1df7-48f8-8938-4ca3eda3e9cc None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.728470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f95cd-1df7-48f8-8938-4ca3eda3e9cc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.728749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f95cd-1df7-48f8-8938-4ca3eda3e9cc None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.730608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1079/2164] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 11:59:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 11:59:24.745875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.746151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.746459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.801032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:24.805145 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.832706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169fbe-875c-4a2e-a58f-efb219fe28ca None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.842536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:24.844179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:24.845254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:24.845728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] PATH_INFO: `/v3/projects/b153e1b797be4fbb9384c949e1176bb2` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:24.851369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b153e1b797be4fbb9384c949e1176bb2)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:24.855289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:24.892098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1080/2165] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 11:59:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:24.908653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:24.910679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:24.929337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e0ab3-59ee-432f-b1f8-43c4f6c9bbdc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:24.961998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b153e1b797be4fbb9384c949e1176bb2', 'request_id': 'req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.978465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b153e1b797be4fbb9384c949e1176bb2', 'request_id': 'req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:24.992864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b153e1b797be4fbb9384c949e1176bb2', 'request_id': 'req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:25.021668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] The token cache is being invalidate because project b153e1b797be4fbb9384c949e1176bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:25.022127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:25.023146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fbc17c2e-7f2e-4a40-8a92-c8c059c501ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:25.033049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1086/2166] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:24 2021] DELETE /identity/v3/projects/b153e1b797be4fbb9384c949e1176bb2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:25.035593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.035872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.036187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.065653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:25.066933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:25.082727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.083402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.083713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.083930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.085994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:25.102053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.103694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ccd5c-d084-42f2-a614-963b5bd97f20 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.116537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1081/2167] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:25.145470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1087/2168] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:25.153613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.153894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.154165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.171673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:25.172906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:25.181380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1082/2169] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:25.188281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.198263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d5559-14c9-459d-8817-cb3b018c3cc4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.204471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.205311 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.205650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.206123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.206943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:25.207615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.208828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.224047 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1088/2170] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:25.229163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.238466 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015797d-9b9e-4bb3-b3e8-c5f5e0e17252 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.243404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.244178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.244479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.244809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.245518 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.247974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.274356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1083/2171] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:25 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:25.279465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.289890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276c08-1691-41b4-8ce9-ba5a8a29b465 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.346749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.347432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.347717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.347991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.348708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.350666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.380017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1089/2172] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:25 2021] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:25.381375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.394033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd19f-adf0-4130-9e5c-3d39f9a78286 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.399314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.400157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.401202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.401202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.401510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.403226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.417647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1084/2173] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:25 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:25.419116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.429210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1bfc0-7522-44fd-be51-d498d868f385 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.436464 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.437145 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.437424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.437693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.438435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.440134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e8116-de53-4566-9f7f-a227b2c9edc2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.455259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1090/2174] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:25 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:25.456503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.468539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ee36-b926-4789-bd59-25b4a9cb8aa7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.476331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.477229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.477502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.477767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] PATH_INFO: `/v3/projects/7ca5ca45c6494bff9a1a66863948f839/users/b9397ca2bd8a4195a2c54dbb1a97ddf0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.494001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca5ca45c6494bff9a1a66863948f839, user_id=b9397ca2bd8a4195a2c54dbb1a97ddf0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.496751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.531044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1085/2175] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:25 2021] PUT /identity/v3/projects/7ca5ca45c6494bff9a1a66863948f839/users/b9397ca2bd8a4195a2c54dbb1a97ddf0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:25.536356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afee5c-eda5-40a2-b2b5-691398e9e6bf None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.536709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afee5c-eda5-40a2-b2b5-691398e9e6bf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.537190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afee5c-eda5-40a2-b2b5-691398e9e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.564000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f3afee5c-eda5-40a2-b2b5-691398e9e6bf None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:25.565193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f3afee5c-eda5-40a2-b2b5-691398e9e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:25.621789 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1091/2176] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:25.631618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:25.633438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:25.697700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b296-fd14-4cd4-b276-c06e7505a0be admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:25.702488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:25.703477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:25.703887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:25.704262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:25.715164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:25.721768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:25.735020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1086/2177] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:26.429294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:26.429782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:26.429858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:26.459185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] MFA Rules not processed for user `b9397ca2bd8a4195a2c54dbb1a97ddf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:26.460509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:26.544945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1092/2178] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:26.555690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:26.557826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:26.672474 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993eeda-e1f1-453d-aac8-67d3b839ae36 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:26.677696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:26.678497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:26.679187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:26.679471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:26.701081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:26.702844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb976-3eb9-4a66-8e6c-54b31a3e6afa service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:26.732388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1087/2179] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:26 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:27.321753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:27.323502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:27.352091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681784-40f3-4a7f-8f84-69edd6ec2d18 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:27.366125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:27.367121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:27.367471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:27.367807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] PATH_INFO: `/v3/users/0399dea2f8374d9c888de647c0347a76` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:27.369134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0399dea2f8374d9c888de647c0347a76)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:27.371205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:27.420471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0399dea2f8374d9c888de647c0347a76'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:27.427519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0399dea2f8374d9c888de647c0347a76'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:27.428208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0399dea2f8374d9c888de647c0347a76'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:27.437218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0399dea2f8374d9c888de647c0347a76'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:27.448727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0399dea2f8374d9c888de647c0347a76'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:27.454565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1093/2180] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:27 2021] DELETE /identity/v3/users/0399dea2f8374d9c888de647c0347a76 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:27.459379 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7af9-844d-42af-a846-786c221fe874 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:27.459663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7af9-844d-42af-a846-786c221fe874 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:27.459936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7af9-844d-42af-a846-786c221fe874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:27.476665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-934f7af9-844d-42af-a846-786c221fe874 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:27.477833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-934f7af9-844d-42af-a846-786c221fe874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:27.543865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1088/2181] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:27.554100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:27.555752 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:27.623188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c85ca-0d1a-45d2-a6c6-47360441dc30 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:27.627310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:27.628396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:27.628588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:27.628930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:27.641918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:27.643395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:27.655760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1094/2182] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:28.019918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7af9-844d-42af-a846-786c221fe874 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.021383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-934f7af9-844d-42af-a846-786c221fe874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:28.036602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7af9-844d-42af-a846-786c221fe874 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:28.041891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:28.042905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.043257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.043481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] PATH_INFO: `/v3/projects/c9c8775318c94f4a9a268a911c6ff143` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.044910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c8775318c94f4a9a268a911c6ff143)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:28.046875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:28.104092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c8775318c94f4a9a268a911c6ff143', 'request_id': 'req-57284f9f-f4be-4b27-afa7-7e0a2215268d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.112907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c8775318c94f4a9a268a911c6ff143', 'request_id': 'req-57284f9f-f4be-4b27-afa7-7e0a2215268d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.118722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c8775318c94f4a9a268a911c6ff143', 'request_id': 'req-57284f9f-f4be-4b27-afa7-7e0a2215268d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.130566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] The token cache is being invalidate because project c9c8775318c94f4a9a268a911c6ff143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:28.130978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.131643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.133217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1089/2183] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:28 2021] DELETE /identity/v3/projects/c9c8775318c94f4a9a268a911c6ff143 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:28.137432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.146863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6a2d-f087-4baf-a1f7-788ac615d0b6 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:28.208960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:28.209946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.210294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.210675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] PATH_INFO: `/v3/users/f9ff575805ef40dd9660bacb205ea8db` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.211971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ff575805ef40dd9660bacb205ea8db)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:28.214113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:28.262632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ff575805ef40dd9660bacb205ea8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.269290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ff575805ef40dd9660bacb205ea8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.269972 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ff575805ef40dd9660bacb205ea8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.279666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ff575805ef40dd9660bacb205ea8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.291560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f9f0a7bb-fc7f-4319-a53f-50fb14b8235e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ff575805ef40dd9660bacb205ea8db'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.297666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1095/2184] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:28 2021] DELETE /identity/v3/users/f9ff575805ef40dd9660bacb205ea8db => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:28.572014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.573650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:28.587948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57284f9f-f4be-4b27-afa7-7e0a2215268d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:28.653402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:28.654340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.654651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.654908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] PATH_INFO: `/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.656313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7203f092b3c4bc19b4c3e449bb657ff)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:28.658216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:28.709504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7203f092b3c4bc19b4c3e449bb657ff', 'request_id': 'req-6611b361-2bed-4624-8dd7-34dc8da0829b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.716705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7203f092b3c4bc19b4c3e449bb657ff', 'request_id': 'req-6611b361-2bed-4624-8dd7-34dc8da0829b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.721963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7203f092b3c4bc19b4c3e449bb657ff', 'request_id': 'req-6611b361-2bed-4624-8dd7-34dc8da0829b'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.733547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] The token cache is being invalidate because project d7203f092b3c4bc19b4c3e449bb657ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:28.733902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.734637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6611b361-2bed-4624-8dd7-34dc8da0829b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:28.736748 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1090/2185] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:28 2021] DELETE /identity/v3/projects/d7203f092b3c4bc19b4c3e449bb657ff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:28.743039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.743772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.743772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.761292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:28.762804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:28.826037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1096/2186] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:28.834024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.834309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.836163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.854167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:28.855432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:28.864916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1091/2187] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:28.868857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.878439 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecd6ac-2684-4894-a26b-b228c3cbac5c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:28.882963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:28.883620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.883895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.884193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.884910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:28.885225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:28.886939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:28.898421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1097/2188] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:28.903775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.912885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffacd9-ced2-4de9-b9d0-896a80397105 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:28.918155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:28.919058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:28.919322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:28.919599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:28.920316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:28.922592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:28.948380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1092/2189] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:28 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:28.952580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:28.963129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce6ec-910b-4c82-bf0d-4c6ef70db3f5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.027002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.027770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.028056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.028323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.029060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.031018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.054102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1098/2190] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:28 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:29.055393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.065797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdcab2-b7c0-4ac2-bbbf-5d5e7becdba5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.071070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.071734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.072010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.072279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.073040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.074768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.085865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1093/2191] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:29.090106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.102124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee269-ff83-473c-925a-5ac7ddb94678 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.108531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.109217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.109494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.109759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.110495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.113083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69427e2e-5187-4c75-b32c-1407e8132b7a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.125363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1099/2192] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:29.129731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.141561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90826-c6ab-446f-9519-de4380e4e91f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.146959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.148175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.148659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.149143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] PATH_INFO: `/v3/projects/614a2f77e51f42429e05ad47350ff7f8/users/9f72babf40e3486f9310fe39732cce1c/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.151190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.151479 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.151753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.166447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=614a2f77e51f42429e05ad47350ff7f8, user_id=9f72babf40e3486f9310fe39732cce1c, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.169363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b507db8-626c-49d2-8050-a0829d003dbc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.171948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] MFA Rules not processed for user `b9397ca2bd8a4195a2c54dbb1a97ddf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:29.173199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:29.192768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1094/2193] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:29 2021] PUT /identity/v3/projects/614a2f77e51f42429e05ad47350ff7f8/users/9f72babf40e3486f9310fe39732cce1c/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:29.195393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.195770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.196125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.226578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] MFA Rules not processed for user `9f72babf40e3486f9310fe39732cce1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:29.227781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:29.232933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1100/2194] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:29.304856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1095/2195] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:29.309116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.319829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28ed7-c962-490b-a3f9-59ca3946a961 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.379999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.380668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.380951 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.381227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.381933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.383953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.411874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1101/2196] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:29.416325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.428718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ccfa-1532-46bc-ad7d-1e6e8254649a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.501426 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.502100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.502382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.502693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.503410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.505738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.534888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1096/2197] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:29.535023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.545544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c8c71-a673-4eb0-8e31-51f1f39cc67c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.552106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.552879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.553257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.553623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.554471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.556820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.570448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1102/2198] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:29.571798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.582435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a980e26-3d43-49bc-ab84-0c314b932040 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.587660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.588473 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.588848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.589277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.590333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.592051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fc202-8e12-4855-aa69-0be290f8f2a2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.602264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1097/2199] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:29.606734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.618205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8192c6-076f-4abc-8440-acfeda382c85 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.623976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.625090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.625400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.625693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] PATH_INFO: `/v3/projects/61a34e7ca63643c2a929c610c92c5b8e/users/3ff689772a8c4025850642426f6ba0e9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.642541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a34e7ca63643c2a929c610c92c5b8e, user_id=3ff689772a8c4025850642426f6ba0e9, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.645309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.658595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1103/2200] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:29 2021] PUT /identity/v3/projects/61a34e7ca63643c2a929c610c92c5b8e/users/3ff689772a8c4025850642426f6ba0e9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:29.670373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.670693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.670973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.703137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] MFA Rules not processed for user `3ff689772a8c4025850642426f6ba0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:29.704351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:29.773995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1098/2201] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:29.778901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.843690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8f80-5b75-4632-847f-53d0270d019e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.848709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.849401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.849667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.849971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.850722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.852614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:29.897949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1104/2202] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:29.901717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:29.915028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bfe81-7ecd-4925-93bc-6af1bf48a336 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:29.982815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:29.983609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:29.990142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:29.990465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:29.991298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:29.993247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.018399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1099/2203] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:29 2021] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:30.020111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.031846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55d405-4c25-4a62-8456-72a8f063bc49 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.036591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.037277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.037559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.037892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.038703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.040347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.051363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1105/2204] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:30.060776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.066440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a58f2-f392-4a59-9b77-8414f3ade2b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.071557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.072807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.073139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.073770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] PATH_INFO: `/v3/projects/f8217d86b93e4411b96bff460c1d5f46/users/a8e4e0177f734219bb0fc6b4be5705ca/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.092484 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8217d86b93e4411b96bff460c1d5f46, user_id=a8e4e0177f734219bb0fc6b4be5705ca, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.095290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.110494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1100/2205] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:30 2021] PUT /identity/v3/projects/f8217d86b93e4411b96bff460c1d5f46/users/a8e4e0177f734219bb0fc6b4be5705ca/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:30.114901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.125807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5cc15-c6f6-43c5-b52c-b008f0fbab35 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.189332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.190005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.190287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.190609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.191346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.192938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c55e4-875f-4825-afb3-8fc311f1be77 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.207359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1106/2206] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:30 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:30.211399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.223567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96595ef-facb-43d8-9855-3cc096288f21 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.228761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.229769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.230109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.230407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] PATH_INFO: `/v3/projects/f8217d86b93e4411b96bff460c1d5f46/users/a8e4e0177f734219bb0fc6b4be5705ca/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.233544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8217d86b93e4411b96bff460c1d5f46, user_id=a8e4e0177f734219bb0fc6b4be5705ca, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.237211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.250567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1101/2207] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:30 2021] PUT /identity/v3/projects/f8217d86b93e4411b96bff460c1d5f46/users/a8e4e0177f734219bb0fc6b4be5705ca/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:30.260798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.261342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.261890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.295184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] MFA Rules not processed for user `a8e4e0177f734219bb0fc6b4be5705ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:30.296904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:30.379229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1107/2208] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:30 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:30.390277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.392461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:30.454619 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120d82e-4808-47c5-8255-f73438a3c4be admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.458670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.459373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.459592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.459870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.470380 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.471947 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.483671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1102/2209] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:30 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:30.528692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:30.540775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfbed6-ca81-4453-b96c-7a1826a6205b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:30.545769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:30.546715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:30.547389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:30.547988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:30.616232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:30.617928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4929-8cab-45a9-8425-f0f6d62f28a6 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:30.630226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1108/2210] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:30 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:43.302659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:43.363266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed1005-91b4-4d39-99a8-4550b6398b19 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:43.368710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:43.369631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:43.369906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:43.370209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] PATH_INFO: `/v3/users/9f72babf40e3486f9310fe39732cce1c` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:43.371560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f72babf40e3486f9310fe39732cce1c)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:43.373542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:43.421733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f72babf40e3486f9310fe39732cce1c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.428792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f72babf40e3486f9310fe39732cce1c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.429467 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f72babf40e3486f9310fe39732cce1c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.441050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f72babf40e3486f9310fe39732cce1c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.441750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f72babf40e3486f9310fe39732cce1c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.456355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1103/2211] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:43 2021] DELETE /identity/v3/users/9f72babf40e3486f9310fe39732cce1c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:43.460996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:43.461456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:43.461547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:43.478724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:43.480426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:43.536724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1109/2212] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:43.547575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:43.549241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:43.607546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02ac2-7a82-4678-b56e-9234d705c1bb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:43.612282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:43.612956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:43.613304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:43.613592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:43.622865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:43.624340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:43.633455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1104/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:43.907960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:43.909782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:43.922373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15aca8-beb2-4093-a621-8cfd032b7cd2 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:43.927979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:43.928956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:43.929269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:43.929566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] PATH_INFO: `/v3/projects/614a2f77e51f42429e05ad47350ff7f8` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:43.930827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=614a2f77e51f42429e05ad47350ff7f8)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:43.932756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:43.987434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614a2f77e51f42429e05ad47350ff7f8', 'request_id': 'req-98bc76a3-341e-4340-b73d-62119408a7ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:43.995378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614a2f77e51f42429e05ad47350ff7f8', 'request_id': 'req-98bc76a3-341e-4340-b73d-62119408a7ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.001343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614a2f77e51f42429e05ad47350ff7f8', 'request_id': 'req-98bc76a3-341e-4340-b73d-62119408a7ff'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.012679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] The token cache is being invalidate because project 614a2f77e51f42429e05ad47350ff7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:44.012953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.013647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.015480 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1110/2214] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:43 2021] DELETE /identity/v3/projects/614a2f77e51f42429e05ad47350ff7f8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:44.019447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:44.028989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7544cd2-5b48-4fb9-8499-5e6dc003baf5 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:44.097740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:44.098891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:44.099139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:44.099406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] PATH_INFO: `/v3/users/3ff689772a8c4025850642426f6ba0e9` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:44.101172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff689772a8c4025850642426f6ba0e9)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:44.103209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:44.164708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff689772a8c4025850642426f6ba0e9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.172422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff689772a8c4025850642426f6ba0e9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.173223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff689772a8c4025850642426f6ba0e9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.186480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff689772a8c4025850642426f6ba0e9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.187838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff689772a8c4025850642426f6ba0e9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.203515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1105/2215] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:44 2021] DELETE /identity/v3/users/3ff689772a8c4025850642426f6ba0e9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:44.671364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:44.672812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:44.687897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc76a3-341e-4340-b73d-62119408a7ff admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:44.763186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:44.764332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:44.765082 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:44.765458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] PATH_INFO: `/v3/projects/61a34e7ca63643c2a929c610c92c5b8e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:44.766992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a34e7ca63643c2a929c610c92c5b8e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:44.770442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:44.822128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a34e7ca63643c2a929c610c92c5b8e', 'request_id': 'req-b36b35e5-6051-4a28-961b-8cc8118fce38'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.830686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a34e7ca63643c2a929c610c92c5b8e', 'request_id': 'req-b36b35e5-6051-4a28-961b-8cc8118fce38'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.836503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a34e7ca63643c2a929c610c92c5b8e', 'request_id': 'req-b36b35e5-6051-4a28-961b-8cc8118fce38'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.847560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] The token cache is being invalidate because project 61a34e7ca63643c2a929c610c92c5b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:44.847847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.848502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.850076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1111/2216] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:44 2021] DELETE /identity/v3/projects/61a34e7ca63643c2a929c610c92c5b8e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:44.854358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:44.855795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:44.868455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab3ea8-6ce2-4042-98c1-7271630e94ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:44.925655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:44.926707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:44.927011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:44.927310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] PATH_INFO: `/v3/users/a8e4e0177f734219bb0fc6b4be5705ca` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:44.928732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e4e0177f734219bb0fc6b4be5705ca)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:44.930833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:44.984191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e4e0177f734219bb0fc6b4be5705ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.990927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e4e0177f734219bb0fc6b4be5705ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:44.991577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e4e0177f734219bb0fc6b4be5705ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.003606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e4e0177f734219bb0fc6b4be5705ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.004233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-96440685-0308-4f70-ae5c-43506def3954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e4e0177f734219bb0fc6b4be5705ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.018266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1106/2217] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:44 2021] DELETE /identity/v3/users/a8e4e0177f734219bb0fc6b4be5705ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:45.363867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.369667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:45.391198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b35e5-6051-4a28-961b-8cc8118fce38 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.462605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.463392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.463673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.463992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] PATH_INFO: `/v3/projects/f8217d86b93e4411b96bff460c1d5f46` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.465408 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8217d86b93e4411b96bff460c1d5f46)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.467793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.523805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8217d86b93e4411b96bff460c1d5f46', 'request_id': 'req-3b3680eb-b023-46eb-8cc5-eabb3a122164'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.533157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8217d86b93e4411b96bff460c1d5f46', 'request_id': 'req-3b3680eb-b023-46eb-8cc5-eabb3a122164'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.544474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8217d86b93e4411b96bff460c1d5f46', 'request_id': 'req-3b3680eb-b023-46eb-8cc5-eabb3a122164'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.551663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] The token cache is being invalidate because project f8217d86b93e4411b96bff460c1d5f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:45.551946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.552583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3b3680eb-b023-46eb-8cc5-eabb3a122164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:45.554134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1112/2218] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:45 2021] DELETE /identity/v3/projects/f8217d86b93e4411b96bff460c1d5f46 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:45.561515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.561796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.562064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.579458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:45.580670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:45.641967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1107/2219] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:45.651796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.652083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.652354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.671559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:45.672907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:45.684891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1113/2220] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:45.686614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.697792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9b981-65b7-4053-9b05-24f2002fbde0 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.703442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.704223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.704505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.704773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.705513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:45.705816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.707628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.720073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1108/2221] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:45.724484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.733608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9042d78-2e44-485c-a910-b51691ee8758 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.744300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.744978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.745226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.745543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.746215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.748130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.780136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1114/2222] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:45 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:45.784134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.796501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2e263-4dc1-4d46-8297-2cefa76f0231 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.864638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.866044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.866322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.866780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.867650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.870668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.893740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1109/2223] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:45 2021] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:45.897893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.911868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75316d96-fcf7-457b-a09e-bbe034185ea8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.917481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.918735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.919185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.919652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.920814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.922790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.940425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1115/2224] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:45.944910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:45.955907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493f03e-7b22-42ef-9d5b-e3215564b0cc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:45.961508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:45.962671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:45.963106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:45.963555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:45.964773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:45.966697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:45.982576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1110/2225] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:45.985169 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.006698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.008548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.008837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b789d9c-a922-47f6-ad1c-7878488d0b3e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.020643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.021560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.021839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.022591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] PATH_INFO: `/v3/projects/db037886fa114c2c87370cf421952247/users/82df377239ae44ab922ef2a5fc009320/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.023303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99627a4-0eb1-4d4e-8939-cbffc7d4e23d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.032330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.033368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.033774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.034081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] PATH_INFO: `/v3/users/9b39dd77d85e4eb1bc76c00e071e97c6` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.035451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b39dd77d85e4eb1bc76c00e071e97c6)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.037396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.040547 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db037886fa114c2c87370cf421952247, user_id=82df377239ae44ab922ef2a5fc009320, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.043217 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d603ab0-e20f-4d1b-a9fb-eb3212b77c7a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.060006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1116/2226] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:45 2021] PUT /identity/v3/projects/db037886fa114c2c87370cf421952247/users/82df377239ae44ab922ef2a5fc009320/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:46.073738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.074005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.074271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.088806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b39dd77d85e4eb1bc76c00e071e97c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.095977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b39dd77d85e4eb1bc76c00e071e97c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.096671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b39dd77d85e4eb1bc76c00e071e97c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.101542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] MFA Rules not processed for user `82df377239ae44ab922ef2a5fc009320`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:46.102768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.107834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b39dd77d85e4eb1bc76c00e071e97c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.108679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b39dd77d85e4eb1bc76c00e071e97c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.122160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1111/2227] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:46 2021] DELETE /identity/v3/users/9b39dd77d85e4eb1bc76c00e071e97c6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:46.169297 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1117/2228] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:46.173599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.175238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.240318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98960d-1415-4360-a2b3-61bde4cdeeee admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.247184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.247859 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.248154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.249064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.249786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.251728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.281983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1112/2229] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:46.285288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.301565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.303381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.384772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3862fd-dd1f-4ed0-9fb5-aeb99f5b9537 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.414735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473de6c-9c2f-4d6d-b381-78e617696526 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.426220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.428332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.428625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.428905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] PATH_INFO: `/v3/projects/cf852b4ffd784cc6a4c15059be11f5c8` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.434407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf852b4ffd784cc6a4c15059be11f5c8)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.437151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.486035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.487166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.487508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.487977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.488872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.491198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.503289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf852b4ffd784cc6a4c15059be11f5c8', 'request_id': 'req-b6240348-46be-4d98-8f1c-9b4f595fe091'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.515921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf852b4ffd784cc6a4c15059be11f5c8', 'request_id': 'req-b6240348-46be-4d98-8f1c-9b4f595fe091'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.522288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1118/2230] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:46.522743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf852b4ffd784cc6a4c15059be11f5c8', 'request_id': 'req-b6240348-46be-4d98-8f1c-9b4f595fe091'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.526654 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.535423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] The token cache is being invalidate because project cf852b4ffd784cc6a4c15059be11f5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:46.535681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.540269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b6240348-46be-4d98-8f1c-9b4f595fe091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:46.541374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec79c8-ae36-4c29-ac1a-4a323f37e3d2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.543443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1113/2231] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:46 2021] DELETE /identity/v3/projects/cf852b4ffd784cc6a4c15059be11f5c8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:46.549739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.550032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.550301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.574301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:46.575626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.668923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.669242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1114/2232] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:46.670083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.670366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.670857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.673083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.673749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08b51c-c9ea-4a48-bb40-a6b2ec85af69 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.692221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1119/2233] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:46 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:46.696569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.698984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.719746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa2f10-6260-4d9f-9649-7c7d881a7c6d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.722640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.722930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.723204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.727932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.728795 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.729079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.729356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.730404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.732103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.749739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1115/2234] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:46 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:46.750263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:46.751489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.753903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.760424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1120/2235] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:46.764907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.768848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe7d4-1ed8-4351-b20a-ae16874a245a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.775275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84761b-d575-4698-9f53-9ff671c092cc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.775666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.776621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.776851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.777497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] PATH_INFO: `/v3/projects/e5da91744dbf45dba352e94e8d413569/users/d5b9fe622a314b4196289cbc36a90089/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.779891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.781485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.781762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.782037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.782801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:46.783198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.785352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.792646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5da91744dbf45dba352e94e8d413569, user_id=d5b9fe622a314b4196289cbc36a90089, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.795446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558896-fcdf-49ce-94e8-f022bc69efd2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.802623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1121/2236] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:46.803621 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.813735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3bbce-5255-409e-aacf-f347618fca56 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.815674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1116/2237] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:46 2021] PUT /identity/v3/projects/e5da91744dbf45dba352e94e8d413569/users/d5b9fe622a314b4196289cbc36a90089/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:46.825654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.825939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.826216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.854286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] MFA Rules not processed for user `d5b9fe622a314b4196289cbc36a90089`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:46.855531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:46.869461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.870113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.870381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.870687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.871386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.873259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.909292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1122/2238] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:46.910450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.925385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1117/2239] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:46.929957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:46.940553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c5efd-bde9-49eb-9b4d-1eb9b92abb47 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.982152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da1a-c93b-4728-a12c-97802bfc5e5c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:46.987554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.988291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.988632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.988913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:46.989652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:46.991657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:46.998541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:46.999477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:46.999477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:46.999724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.000508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.002432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.014884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1123/2240] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:47.019112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.030328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33d16-749e-4650-adda-27c57813ea4f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.032370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1118/2241] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:46 2021] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:47.038017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.102326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.103308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.103716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.104090 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.104848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.107328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.115587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b234e-7ab2-4f55-92c2-7dda476226fc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.118692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1124/2242] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:47.122645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.125907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.126676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.126953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.127225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.128956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.131509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.134369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77cfb6-ef70-40c6-9fcb-134ae48722e2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.139524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.140699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.140978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.141262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.142115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.143829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.155897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1125/2243] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:47.159877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1119/2244] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:47.160382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.161115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.171746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d69ff-98b8-47fb-9178-d99ad260934c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.174446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4088-e434-45b8-a600-7860f5182147 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.176330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.177247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.177517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.177811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] PATH_INFO: `/v3/projects/13c791837e584191b6e19e76b884b9c5/users/ae93ac7e1d9b4932ae6f381eb3f245c1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.180229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.180932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.181229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.181504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.182284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.183932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.192631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c791837e584191b6e19e76b884b9c5, user_id=ae93ac7e1d9b4932ae6f381eb3f245c1, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.194273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1120/2245] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:47.196166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e2130-1446-415a-a2ac-81aba4b35834 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.198295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.208695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3e07-e54e-43aa-9c86-19eeb8df3751 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.212094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1126/2246] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:47 2021] PUT /identity/v3/projects/13c791837e584191b6e19e76b884b9c5/users/ae93ac7e1d9b4932ae6f381eb3f245c1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:47.221883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.222210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.222600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.250691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] MFA Rules not processed for user `ae93ac7e1d9b4932ae6f381eb3f245c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:47.251902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.265946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.266868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.267148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.267416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] PATH_INFO: `/v3/projects/1d08e136db614ee38aead900968cefed/users/9384fd121cf946f2801b215539a734c1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.282634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08e136db614ee38aead900968cefed, user_id=9384fd121cf946f2801b215539a734c1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.285416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.298738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1121/2247] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:47 2021] PUT /identity/v3/projects/1d08e136db614ee38aead900968cefed/users/9384fd121cf946f2801b215539a734c1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:47.302639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.317681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1127/2248] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:47.322072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.332982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f24762-9726-49a5-b3dd-6e4ace1ac082 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.367124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d9073-dbdd-47d4-8a40-e55cf3ffe692 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.373547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.374604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.375089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.375569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.377570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.380290 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.395327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1122/2249] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:47.398998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.399237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.399667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.400267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.400267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.400897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.402814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.410316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51468-964c-4371-9077-9eb131dae33f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.416339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.417512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.417865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.418109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] PATH_INFO: `/v3/projects/1d08e136db614ee38aead900968cefed/users/9384fd121cf946f2801b215539a734c1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.420497 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08e136db614ee38aead900968cefed, user_id=9384fd121cf946f2801b215539a734c1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.423746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812cd37-f96f-4f6c-a86a-7f05253abd9a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.440206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1128/2251] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:47.440622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1123/2251] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:47 2021] PUT /identity/v3/projects/1d08e136db614ee38aead900968cefed/users/9384fd121cf946f2801b215539a734c1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:47.447706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.451842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.452323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.454849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.482273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] MFA Rules not processed for user `9384fd121cf946f2801b215539a734c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:47.483872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.519398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2656eb-13e4-41dc-8de7-624deda453f0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.524668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.525339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.526235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.526538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.527259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.529204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.552943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1129/2252] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/users => generated 308 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:47.553736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.556031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1124/2253] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:47.563522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd567-1acf-4973-8a2b-59e4e9d3a186 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.566971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.568287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.568462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.568947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.569232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.569506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.570273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.571925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.582546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1130/2254] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:47.586638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.596695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf585b-3d29-4f03-a06b-49a0cbbe2d34 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.601371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.602260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.602562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.602845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] PATH_INFO: `/v3/projects/121bccf0140c45de9d6c935ee67db6e7/users/6bba58189a2d4d09be6247d874a911fe/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.618557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121bccf0140c45de9d6c935ee67db6e7, user_id=6bba58189a2d4d09be6247d874a911fe, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.621312 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.625516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec214e7-529a-4f9c-a790-1f7c701f9d64 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.629596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.630461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.630998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.631274 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.633137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.636730 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1131/2255] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:47 2021] PUT /identity/v3/projects/121bccf0140c45de9d6c935ee67db6e7/users/6bba58189a2d4d09be6247d874a911fe/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:47.640768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.700990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.702525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.712500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1125/2256] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:47.713117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69076-6f02-452b-a594-078a6679f147 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.721725 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.722603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.723023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.723396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.724273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.726097 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.742708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1132/2257] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:47 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:47.744976 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.752544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:47.759253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.761794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575b179-f6f5-4c71-a70c-e0450c7f0d8b service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.767662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.768650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.769000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.769335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] PATH_INFO: `/v3/projects/121bccf0140c45de9d6c935ee67db6e7/users/6bba58189a2d4d09be6247d874a911fe/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.771761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=121bccf0140c45de9d6c935ee67db6e7, user_id=6bba58189a2d4d09be6247d874a911fe, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.778651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f39b0d-8e31-4c1d-8cbb-163b723c6c7b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.784497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262e5e8-482a-4aad-9310-50331fde9207 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:47.796273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1126/2258] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:47 2021] PUT /identity/v3/projects/121bccf0140c45de9d6c935ee67db6e7/users/6bba58189a2d4d09be6247d874a911fe/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:47.808228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.808435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.808716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.853393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] MFA Rules not processed for user `6bba58189a2d4d09be6247d874a911fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:47.855227 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:47.897239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:47.899343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:47.899343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:47.899343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] PATH_INFO: `/v3/users/423d96acc7624c9d9e4cdcfa13945f13` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:47.899948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423d96acc7624c9d9e4cdcfa13945f13)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:47.902366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:47.975636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423d96acc7624c9d9e4cdcfa13945f13'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:47.986717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423d96acc7624c9d9e4cdcfa13945f13'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:47.987634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423d96acc7624c9d9e4cdcfa13945f13'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:47.996890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1127/2259] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:47 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:48.005659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423d96acc7624c9d9e4cdcfa13945f13'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.007091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:48.008746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.020265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-0f5df778-05fd-45b7-a986-b6c2305aafa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423d96acc7624c9d9e4cdcfa13945f13'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.027322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1133/2260] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:47 2021] DELETE /identity/v3/users/423d96acc7624c9d9e4cdcfa13945f13 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:48.041015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.041715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.042062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.069845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:48.071282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.081517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e59ee-675c-479e-8923-cd4187cfe7f5 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:48.158127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1134/2261] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:48.162879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:48.163578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.163862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.164142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.166092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.169173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:48.171014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.238301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a2cda-0e37-42e9-b014-c03a38cdf17c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:48.242441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:48.243146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:48.243268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.243571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.243994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.244636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:48.255128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:48.255332 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1128/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:48 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:48.257014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:48.267616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1135/2263] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:48.568007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:48.569563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.584746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eef6e6-a711-4d13-812d-5bf604b06751 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:48.590040 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:48.591431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.591774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.592146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] PATH_INFO: `/v3/projects/4c05f8232ea54ec0b4ba4b6541b3f2bd` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.593650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c05f8232ea54ec0b4ba4b6541b3f2bd)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:48.595801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:48.631261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:48.632733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.655602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4868f38-a82d-4185-836a-3784b989d099 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:48.657811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c05f8232ea54ec0b4ba4b6541b3f2bd', 'request_id': 'req-aa9a546f-40c2-415e-aa4c-104446cb22b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.669014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c05f8232ea54ec0b4ba4b6541b3f2bd', 'request_id': 'req-aa9a546f-40c2-415e-aa4c-104446cb22b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.675711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c05f8232ea54ec0b4ba4b6541b3f2bd', 'request_id': 'req-aa9a546f-40c2-415e-aa4c-104446cb22b8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.688172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] The token cache is being invalidate because project 4c05f8232ea54ec0b4ba4b6541b3f2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:48.688595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.689618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-aa9a546f-40c2-415e-aa4c-104446cb22b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.702877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1129/2264] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:48 2021] DELETE /identity/v3/projects/4c05f8232ea54ec0b4ba4b6541b3f2bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:48.727619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:48.728534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.728815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.729089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] PATH_INFO: `/v3/users/ae93ac7e1d9b4932ae6f381eb3f245c1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.730378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae93ac7e1d9b4932ae6f381eb3f245c1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:48.732392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:48.784603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae93ac7e1d9b4932ae6f381eb3f245c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.792567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae93ac7e1d9b4932ae6f381eb3f245c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.793432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae93ac7e1d9b4932ae6f381eb3f245c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.803292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae93ac7e1d9b4932ae6f381eb3f245c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.818776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae93ac7e1d9b4932ae6f381eb3f245c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:48.825750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1136/2265] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:48 2021] DELETE /identity/v3/users/ae93ac7e1d9b4932ae6f381eb3f245c1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:48.830917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.831291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.831604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:48.851491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:48.852758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.916137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1130/2266] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:48.926832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:48.928245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:48.988201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a7d-b5c4-4b40-ba5e-3bb08337e632 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:48.992969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:48.993628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:48.993907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:48.994179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:49.005223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:49.006708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:49.016914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1137/2267] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:49.316677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:49.318261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:49.392070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b166c4-dfab-4bdb-b9eb-6c0293d00160 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:49.395806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:49.396462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:49.396740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:49.397013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:49.398873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:49.463777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:49.465658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:49.482359 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:49.483902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:49.484076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cd017-3045-4023-9c57-fb260ea12fd6 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:49.497722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:49.498573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1131/2268] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:49 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:49.498805 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:49.499146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:49.499428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] PATH_INFO: `/v3/projects/13c791837e584191b6e19e76b884b9c5` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:49.500668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c791837e584191b6e19e76b884b9c5)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:49.502623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:49.558295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c791837e584191b6e19e76b884b9c5', 'request_id': 'req-2cc22f76-9f4a-43c2-9992-cdddac49f083'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.567983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c791837e584191b6e19e76b884b9c5', 'request_id': 'req-2cc22f76-9f4a-43c2-9992-cdddac49f083'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.573749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c791837e584191b6e19e76b884b9c5', 'request_id': 'req-2cc22f76-9f4a-43c2-9992-cdddac49f083'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.588877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] The token cache is being invalidate because project 13c791837e584191b6e19e76b884b9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:49.589186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.589859 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.591670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1138/2269] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:49 2021] DELETE /identity/v3/projects/13c791837e584191b6e19e76b884b9c5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:49.595878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:49.607707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec279f-a5eb-42e3-b569-2a66272af9b1 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:49.674905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:49.675790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:49.676188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:49.676457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] PATH_INFO: `/v3/users/6bba58189a2d4d09be6247d874a911fe` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:49.677667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba58189a2d4d09be6247d874a911fe)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:49.680335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:49.743025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba58189a2d4d09be6247d874a911fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.750647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba58189a2d4d09be6247d874a911fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.751324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba58189a2d4d09be6247d874a911fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.763114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba58189a2d4d09be6247d874a911fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.763920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba58189a2d4d09be6247d874a911fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:49.777056 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1132/2270] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:49 2021] DELETE /identity/v3/users/6bba58189a2d4d09be6247d874a911fe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:50.069075 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.070782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.092631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22f76-9f4a-43c2-9992-cdddac49f083 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.112561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.113960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.150801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.152036 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.152299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.152588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] PATH_INFO: `/v3/projects/121bccf0140c45de9d6c935ee67db6e7` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.153969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=121bccf0140c45de9d6c935ee67db6e7)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.156576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.178204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cabd6-0a4f-4c49-a730-cf79f03d2479 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.181833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.182472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.182785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.183340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.185521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.205123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121bccf0140c45de9d6c935ee67db6e7', 'request_id': 'req-4d9efa65-8bfe-4184-86fc-0aea70628d3a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:50.212659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121bccf0140c45de9d6c935ee67db6e7', 'request_id': 'req-4d9efa65-8bfe-4184-86fc-0aea70628d3a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:50.220124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121bccf0140c45de9d6c935ee67db6e7', 'request_id': 'req-4d9efa65-8bfe-4184-86fc-0aea70628d3a'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:50.231701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] The token cache is being invalidate because project 121bccf0140c45de9d6c935ee67db6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:50.232005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:50.232681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4d9efa65-8bfe-4184-86fc-0aea70628d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:50.234449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1139/2271] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:50 2021] DELETE /identity/v3/projects/121bccf0140c45de9d6c935ee67db6e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:50.240213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.240491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.240815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.251355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.253764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72643f82-fa44-4759-8a89-11aeaf07de2b service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.258808 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:50.259985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.264598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1133/2272] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:50 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:50.322926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1140/2273] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:50.333223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.333694 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.333785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.368771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:50.369992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.386065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1134/2274] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:50.387131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.398368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf6d48-6424-417d-bcce-4ca1c9b10054 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.405446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.407030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.407691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.407802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.408489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:50.408843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.410790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.426761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1141/2275] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 11:59:50.431239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.442486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719a337-068d-41ff-b610-5630ff2fb4dd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.449261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.450444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.450775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.451056 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.452414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.454464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.497182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1135/2276] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:50.503124 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.518399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a2b68-c3ca-416c-b737-e399f812224c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.590204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.590944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.591232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.591510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.592253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.594385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.622678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1142/2277] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:50.625688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.636196 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa54d-6e4a-4a42-94e3-98a7cbfb561a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.641304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.641978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.642264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.642561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.643366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.644905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.658680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1136/2278] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:50.659755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.669833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c6ba-a2d0-40cd-9191-d27625d474dc admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.675114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.675775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.676057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.676330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.677081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.678719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec36c-3cab-430e-a87e-faea48fc4ac7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.688850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1143/2279] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:50.693073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.703420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3302bf-9dc8-4852-af5b-7a43405612df admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.708326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.709211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.709652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.709929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] PATH_INFO: `/v3/projects/c4290274bd87453e8f27d2b1386c20d0/users/c758e502946b41118292beba50782c27/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.725863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4290274bd87453e8f27d2b1386c20d0, user_id=c758e502946b41118292beba50782c27, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.728669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.743780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1137/2280] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:50 2021] PUT /identity/v3/projects/c4290274bd87453e8f27d2b1386c20d0/users/c758e502946b41118292beba50782c27/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:50.753847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.754139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.754414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.787372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] MFA Rules not processed for user `c758e502946b41118292beba50782c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:50.788622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:50.866026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1144/2281] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:50.870535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.935707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4284a-8551-4b3d-9d13-f62f99e458d6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:50.940978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:50.941652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:50.941926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:50.942199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:50.942942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:50.944849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:50.971414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1138/2282] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:50.975454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:50.987406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56948ccf-7529-49a6-b7b7-b89d966b932f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.046716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.047401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.047711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.048024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.048735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.050684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.072347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1145/2283] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:50 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:51.076478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.087672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f165a-fcee-4dd1-b3d9-755169f34d9d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.093593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.094262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.094557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.094863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.095603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.097184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.109209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1139/2284] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:51.113111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.124000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75c042-6680-42b6-8c16-089620d4e712 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.128756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.129663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.129936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.130204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] PATH_INFO: `/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1/users/2378d8b2a10c40748b419262198aecb3/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.145879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4cff62b6d34c928772cc8f5cef3ae1, user_id=2378d8b2a10c40748b419262198aecb3, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.148548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.163825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1146/2285] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:51 2021] PUT /identity/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1/users/2378d8b2a10c40748b419262198aecb3/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:51.167993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.178349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6142bee-2581-40f6-a00d-f116f6be7c0a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.240281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.240868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.241178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.241410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.242214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.243818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e29fd-998a-4068-9100-e417ea78ef4e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.254455 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1140/2286] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:51 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:51.258770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.277500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c8a77-0514-4fca-8189-19c8df39661d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.283149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.284091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.284384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.284656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] PATH_INFO: `/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1/users/2378d8b2a10c40748b419262198aecb3/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.286694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4cff62b6d34c928772cc8f5cef3ae1, user_id=2378d8b2a10c40748b419262198aecb3, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.289365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.300738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1147/2287] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:51 2021] PUT /identity/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1/users/2378d8b2a10c40748b419262198aecb3/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:51.312713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.313001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.313277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.341888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] MFA Rules not processed for user `2378d8b2a10c40748b419262198aecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:51.343521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:51.417683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1141/2288] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:51 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:51.428449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.430442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:51.490117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0f08d-6b57-4f68-b020-cf7b1fd5593f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.494704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.495401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.495683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.495990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.511186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.513011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.524738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1148/2289] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:51 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:51.626004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:51.629045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:51.643412 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226831e-41de-48d0-ab91-97443f4b009b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:51.648143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:51.648897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:51.649306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:51.649686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:51.757577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:51.759215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d010-2aee-4aed-bf26-b680c41756ca service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:51.769382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1142/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:51 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:51.967550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:52.033088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2a5cf-f47f-4b20-a3b6-7ee60f6b4120 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:52.037822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:52.038719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:52.038996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:52.039266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] PATH_INFO: `/v3/users/c758e502946b41118292beba50782c27` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:52.040466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c758e502946b41118292beba50782c27)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:52.042378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:52.095964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c758e502946b41118292beba50782c27'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.102883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c758e502946b41118292beba50782c27'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.103548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c758e502946b41118292beba50782c27'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.112016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c758e502946b41118292beba50782c27'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.126023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c758e502946b41118292beba50782c27'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.132055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1149/2291] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:51 2021] DELETE /identity/v3/users/c758e502946b41118292beba50782c27 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:52.136908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:52.137190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:52.137637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:52.157399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:52.157399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:52.215743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1143/2292] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:52.225953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:52.227617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:52.289187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44601021-d2d9-4f56-a3c3-233eb7dbbafb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:52.293626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:52.294271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:52.294577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:52.294877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:52.304435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:52.305997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:52.317337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1150/2293] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:52.600561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:52.602073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:52.614358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b2a9-5ff8-4751-a132-c36280529e58 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:52.619161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:52.620067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:52.620299 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:52.620550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] PATH_INFO: `/v3/projects/c4290274bd87453e8f27d2b1386c20d0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:52.621758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4290274bd87453e8f27d2b1386c20d0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:52.623838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:52.674427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4290274bd87453e8f27d2b1386c20d0', 'request_id': 'req-03948974-f977-40f4-a8a8-5546cbc81ea0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.682817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4290274bd87453e8f27d2b1386c20d0', 'request_id': 'req-03948974-f977-40f4-a8a8-5546cbc81ea0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.689146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4290274bd87453e8f27d2b1386c20d0', 'request_id': 'req-03948974-f977-40f4-a8a8-5546cbc81ea0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.700540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] The token cache is being invalidate because project c4290274bd87453e8f27d2b1386c20d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:52.700823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.701520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.703512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1144/2294] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:52 2021] DELETE /identity/v3/projects/c4290274bd87453e8f27d2b1386c20d0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:52.707619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:52.717285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b82f8-d376-4316-8c27-2db77d75e895 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:52.782434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:52.783501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:52.783780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:52.784030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] PATH_INFO: `/v3/users/2378d8b2a10c40748b419262198aecb3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:52.785338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2378d8b2a10c40748b419262198aecb3)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:52.787361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:52.848004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2378d8b2a10c40748b419262198aecb3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.855596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2378d8b2a10c40748b419262198aecb3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.856386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2378d8b2a10c40748b419262198aecb3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.865733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2378d8b2a10c40748b419262198aecb3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.878504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5de580b3-887a-494c-9558-6d10ad4bb74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2378d8b2a10c40748b419262198aecb3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:52.884766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1151/2295] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:52 2021] DELETE /identity/v3/users/2378d8b2a10c40748b419262198aecb3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:53.262217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.263664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:53.277835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03948974-f977-40f4-a8a8-5546cbc81ea0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.348108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.349408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.349688 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.349959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] PATH_INFO: `/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.351248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4cff62b6d34c928772cc8f5cef3ae1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.353149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.415085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4cff62b6d34c928772cc8f5cef3ae1', 'request_id': 'req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:53.422919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4cff62b6d34c928772cc8f5cef3ae1', 'request_id': 'req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:53.428025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4cff62b6d34c928772cc8f5cef3ae1', 'request_id': 'req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:53.438416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] The token cache is being invalidate because project 0e4cff62b6d34c928772cc8f5cef3ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:53.438796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:53.439398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-85b3ff0f-8b23-48a0-92d7-bf6e1213adf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:53.440975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1145/2296] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:53 2021] DELETE /identity/v3/projects/0e4cff62b6d34c928772cc8f5cef3ae1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:53.446765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.447231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.447355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.465307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:53.466525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:53.540780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1152/2297] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:53.549213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.549502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.549781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.569878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:53.571304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:53.579921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1146/2298] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:53.584733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.596495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fb5e9-a984-41d2-8c16-05e68e2be30a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.602261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.602900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.603185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.603456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.604262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 11:59:53.604587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.606306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.619093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1153/2299] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 11:59:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 11:59:53.624032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.633832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a44b5-543d-4188-ad42-56e39c49b060 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.638894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.639594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.639906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.640204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.640950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.642903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.672913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1147/2300] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:53 2021] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 11:59:53.677182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.687790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba519d6-063f-46cd-84c3-1d2402c0f327 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.746830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.747491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.747767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.748019 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.748826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.750862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.773834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1154/2301] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:53 2021] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:53.778103 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.789139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f2c4-09b7-4fee-91ba-73cbeff8d735 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.796348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.797043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.797316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.797589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.798340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.799984 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.811038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1148/2302] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:53.815539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.826156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42acd3-1e03-4cf5-af3a-b596c3e8a62d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.831193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.831855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.832136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.832409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.833154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.834783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea86d4e-ac97-4a72-8757-266b34afa804 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.844732 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1155/2303] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 11:59:53.849045 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:53.859516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446380a-b852-45e1-973f-b2a06a7256ce admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:53.864639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:53.865520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.865806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.866041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] PATH_INFO: `/v3/projects/618b507aeaf24be7b416d41bbf2b94fb/users/49599a27e419448cb40f393840672bd2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.881399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618b507aeaf24be7b416d41bbf2b94fb, user_id=49599a27e419448cb40f393840672bd2, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:53.884059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:53.898530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1149/2304] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:53 2021] PUT /identity/v3/projects/618b507aeaf24be7b416d41bbf2b94fb/users/49599a27e419448cb40f393840672bd2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:53.910056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:53.910430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:53.910792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:53.947553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] MFA Rules not processed for user `49599a27e419448cb40f393840672bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:53.948916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.028780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1156/2305] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:53 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:54.033812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.100904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f228b-0c4a-473d-8741-9b696c6e0eb1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.108094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.109081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.109442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.109830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.110544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.112914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.147021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1150/2306] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 11:59:54 2021] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:54.148236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.160232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa773e-6254-42bc-8254-e59fe18cb527 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.201895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.204348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.220474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.221128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.221412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.221711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.224471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.224471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.247254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1157/2307] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 11:59:54 2021] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 11:59:54.251257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.260873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d06409-9cba-4ed4-a24d-5073391f0b52 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.266206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.266896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.267182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.267456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.268193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.269806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.272686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02701fd1-683a-4e36-8d30-ce2385427527 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.277543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.278413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.278722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.278996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] PATH_INFO: `/v3/users/82df377239ae44ab922ef2a5fc009320` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.280002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1158/2308] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:54.280266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82df377239ae44ab922ef2a5fc009320)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.282264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.283982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.293421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdc80-e657-4781-847a-08ad5f6ddcf0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.298202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.299107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.299386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.299657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] PATH_INFO: `/v3/projects/0dc46eac0398439d9d41ba5c2412cc62/users/8c8de4c4026a41279e468fc9d759f009/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.315948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc46eac0398439d9d41ba5c2412cc62, user_id=8c8de4c4026a41279e468fc9d759f009, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.318989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.332864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82df377239ae44ab922ef2a5fc009320'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:54.333693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1159/2309] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:54 2021] PUT /identity/v3/projects/0dc46eac0398439d9d41ba5c2412cc62/users/8c8de4c4026a41279e468fc9d759f009/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:54.337672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.339835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82df377239ae44ab922ef2a5fc009320'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:54.340545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82df377239ae44ab922ef2a5fc009320'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:54.352572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82df377239ae44ab922ef2a5fc009320'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:54.353286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-6aa10d18-c1eb-4e58-b7d2-172443267d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82df377239ae44ab922ef2a5fc009320'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:54.369175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1151/2310] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:54 2021] DELETE /identity/v3/users/82df377239ae44ab922ef2a5fc009320 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:54.376232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.376550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.376833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.399146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:54.400340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.423650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69197dde-b031-4cd2-ae42-cd13fc5a434b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.461595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1152/2311] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 11:59:54.474450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.478405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.494318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.494318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.495023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.495023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.495739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.497943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.508912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1160/2312] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 11:59:54 2021] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 11:59:54.515666 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.517790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.535922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84503-1836-443f-814b-4e9153c7f9d8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.541065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.541780 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3f4f7-19b9-4434-a07c-f0396fc7626e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.542127 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.542526 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.542935 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] PATH_INFO: `/v3/projects/0dc46eac0398439d9d41ba5c2412cc62/users/8c8de4c4026a41279e468fc9d759f009/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.544932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc46eac0398439d9d41ba5c2412cc62, user_id=8c8de4c4026a41279e468fc9d759f009, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.545715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.546432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.546739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.547009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.548688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030f67-f640-4ba3-ac8c-7eef3b80bf8b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.556702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.558130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.560110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1161/2313] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 11:59:54 2021] PUT /identity/v3/projects/0dc46eac0398439d9d41ba5c2412cc62/users/8c8de4c4026a41279e468fc9d759f009/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:54.571565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.571901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.572130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.575486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1153/2314] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:54.612586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] MFA Rules not processed for user `8c8de4c4026a41279e468fc9d759f009`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 11:59:54.613714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.708513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1162/2315] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 11:59:54 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 11:59:54.721051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.722844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.786358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffff7-f475-472b-9bb1-f4844c4ef3c1 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.835961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.836618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.836900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.837178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.847083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.848556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.859157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1154/2316] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:54 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 11:59:54.896899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.898337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:54.975908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:54.978430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c83be-5842-485f-b123-fa0a5e636a5a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.984352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.988424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.988424 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.988578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6012d4-3205-477f-bd94-8f9b89146dcc service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:54.988664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] PATH_INFO: `/v3/projects/db037886fa114c2c87370cf421952247` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.988664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=db037886fa114c2c87370cf421952247)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:54.989475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:54.989646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:54.990255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:54.990785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:54.991075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:54.992936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:55.043473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db037886fa114c2c87370cf421952247', 'request_id': 'req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.052749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db037886fa114c2c87370cf421952247', 'request_id': 'req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.058750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db037886fa114c2c87370cf421952247', 'request_id': 'req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.064963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:55.066796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:55.071310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] The token cache is being invalidate because project db037886fa114c2c87370cf421952247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:55.071602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.072267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.073900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1163/2317] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:54 2021] DELETE /identity/v3/projects/db037886fa114c2c87370cf421952247 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 11:59:55.078371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:55.080383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:55.083471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1155/2318] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 11:59:54 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 11:59:55.146182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5d61-aed4-4a34-a66d-f3749bd41aed admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:55.150961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:55.151845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:55.152122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:55.152395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] PATH_INFO: `/v3/users/d5b9fe622a314b4196289cbc36a90089` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:55.153599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b9fe622a314b4196289cbc36a90089)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:55.155828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:55.205692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b9fe622a314b4196289cbc36a90089'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.213565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b9fe622a314b4196289cbc36a90089'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.214311 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b9fe622a314b4196289cbc36a90089'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.223136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b9fe622a314b4196289cbc36a90089'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.234911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b9fe622a314b4196289cbc36a90089'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.241286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1164/2319] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:55 2021] DELETE /identity/v3/users/d5b9fe622a314b4196289cbc36a90089 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:55.531092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:55.545875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178d5dc-731e-46f8-adc5-2f8e5a3482f0 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:55.613708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:55.614776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:55.614934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:55.615206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] PATH_INFO: `/v3/projects/e5da91744dbf45dba352e94e8d413569` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:55.616510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5da91744dbf45dba352e94e8d413569)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:55.618371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:55.666035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5da91744dbf45dba352e94e8d413569', 'request_id': 'req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.674821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5da91744dbf45dba352e94e8d413569', 'request_id': 'req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.681911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5da91744dbf45dba352e94e8d413569', 'request_id': 'req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.694302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] The token cache is being invalidate because project e5da91744dbf45dba352e94e8d413569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:55.694852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.695714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.697382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1156/2320] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:55 2021] DELETE /identity/v3/projects/e5da91744dbf45dba352e94e8d413569 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:55.701310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:55.703873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:55.717403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789eac-81dc-434a-be6a-fe2d84723da2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:55.778171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:55.778852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:55.779130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:55.779520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] PATH_INFO: `/v3/users/9384fd121cf946f2801b215539a734c1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:55.780804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9384fd121cf946f2801b215539a734c1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:55.782887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:55.838831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9384fd121cf946f2801b215539a734c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.846319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9384fd121cf946f2801b215539a734c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.847058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9384fd121cf946f2801b215539a734c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.856403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9384fd121cf946f2801b215539a734c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.868976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9384fd121cf946f2801b215539a734c1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:55.874719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1165/2321] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:55 2021] DELETE /identity/v3/users/9384fd121cf946f2801b215539a734c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:56.153367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:56.154969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:56.167828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c5fe-9d2b-49e0-bd0a-68031e2e7357 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 11:59:56.225979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 11:59:56.226884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 11:59:56.227165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 11:59:56.227439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] PATH_INFO: `/v3/projects/1d08e136db614ee38aead900968cefed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 11:59:56.228709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d08e136db614ee38aead900968cefed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 11:59:56.230691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 11:59:56.288027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d08e136db614ee38aead900968cefed', 'request_id': 'req-ff8674ce-3a1a-40bf-900b-f567422c52ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:56.297282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d08e136db614ee38aead900968cefed', 'request_id': 'req-ff8674ce-3a1a-40bf-900b-f567422c52ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:56.302946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d08e136db614ee38aead900968cefed', 'request_id': 'req-ff8674ce-3a1a-40bf-900b-f567422c52ca'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:56.314561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] The token cache is being invalidate because project 1d08e136db614ee38aead900968cefed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 11:59:56.314846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:56.315519 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ff8674ce-3a1a-40bf-900b-f567422c52ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 11:59:56.317119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1157/2322] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 11:59:56 2021] DELETE /identity/v3/projects/1d08e136db614ee38aead900968cefed => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 11:59:59.974625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 11:59:59.976520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 11:59:59.990842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a908-06ae-400f-a7bb-2cc8f1e70d29 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:00.058152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:00.059070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.059351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.059617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] PATH_INFO: `/v3/users/49599a27e419448cb40f393840672bd2` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.060956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49599a27e419448cb40f393840672bd2)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:00.063062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:00.112632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49599a27e419448cb40f393840672bd2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.119586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49599a27e419448cb40f393840672bd2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.120330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49599a27e419448cb40f393840672bd2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.129942 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49599a27e419448cb40f393840672bd2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.142895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49599a27e419448cb40f393840672bd2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.148861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1166/2323] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 11:59:59 2021] DELETE /identity/v3/users/49599a27e419448cb40f393840672bd2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:00.153513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.154044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.154044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.174789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:00.176037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:00.240043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1158/2324] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:00.250399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:00.251888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:00.311887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372d67a-253d-45fb-b921-ff4d315cd148 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:00.315933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:00.316592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.316869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.317139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.327164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:00.328604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72157bde-7dbb-446b-92c9-96f72a4b3994 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:00.338179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1167/2325] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:00.626759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:00.628387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:00.650476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad76c1-d1b6-4028-93c3-7aa0f396f993 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:00.662065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.662377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.662698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.667770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:00.668656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.668940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.669216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] PATH_INFO: `/v3/projects/618b507aeaf24be7b416d41bbf2b94fb` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.670633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618b507aeaf24be7b416d41bbf2b94fb)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:00.672563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:00.682043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] MFA Rules not processed for user `b9397ca2bd8a4195a2c54dbb1a97ddf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:00.683365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:00.724105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618b507aeaf24be7b416d41bbf2b94fb', 'request_id': 'req-ad71e939-95ff-471b-a2e3-8066fc0c5f23'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.734656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618b507aeaf24be7b416d41bbf2b94fb', 'request_id': 'req-ad71e939-95ff-471b-a2e3-8066fc0c5f23'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.741028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618b507aeaf24be7b416d41bbf2b94fb', 'request_id': 'req-ad71e939-95ff-471b-a2e3-8066fc0c5f23'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.746040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1168/2326] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:00 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:00.754941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] The token cache is being invalidate because project 618b507aeaf24be7b416d41bbf2b94fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:00.755052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.755701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.760070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1159/2327] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:00 2021] DELETE /identity/v3/projects/618b507aeaf24be7b416d41bbf2b94fb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:00.761594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:00.777471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d5ac-37a6-4ca6-b05a-018163ba0f7b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:00.836754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:00.837798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:00.838167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:00.838503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] PATH_INFO: `/v3/users/8c8de4c4026a41279e468fc9d759f009` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:00.839998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8de4c4026a41279e468fc9d759f009)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:00.841958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:00.889202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8de4c4026a41279e468fc9d759f009'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.896039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8de4c4026a41279e468fc9d759f009'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.896705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8de4c4026a41279e468fc9d759f009'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.904746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8de4c4026a41279e468fc9d759f009'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.924462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c8ca7cff-367b-4541-b5fe-c66581acff29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8de4c4026a41279e468fc9d759f009'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:00.931825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1169/2328] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:00 2021] DELETE /identity/v3/users/8c8de4c4026a41279e468fc9d759f009 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:00:01.231693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.234447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:01.250396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71e939-95ff-471b-a2e3-8066fc0c5f23 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.313674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.314682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.315200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.315661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] PATH_INFO: `/v3/projects/0dc46eac0398439d9d41ba5c2412cc62` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.317192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc46eac0398439d9d41ba5c2412cc62)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.319275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.373953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc46eac0398439d9d41ba5c2412cc62', 'request_id': 'req-b0745279-262a-4fc6-8b1a-e5627064a7c0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:01.382092 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc46eac0398439d9d41ba5c2412cc62', 'request_id': 'req-b0745279-262a-4fc6-8b1a-e5627064a7c0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:01.387750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc46eac0398439d9d41ba5c2412cc62', 'request_id': 'req-b0745279-262a-4fc6-8b1a-e5627064a7c0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:01.399573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] The token cache is being invalidate because project 0dc46eac0398439d9d41ba5c2412cc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:01.399864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:01.400553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b0745279-262a-4fc6-8b1a-e5627064a7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:01.402130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1160/2329] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:01 2021] DELETE /identity/v3/projects/0dc46eac0398439d9d41ba5c2412cc62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:00:01.408415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.408886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.409057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.430901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:01.432135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:01.497117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1170/2330] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:01.505140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.505444 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.505697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.525505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:01.526723 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:01.535177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1161/2331] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:01.539429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.549526 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a936-c41a-475b-b75a-43b536e20b95 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.558756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.559441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.559724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.559991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.560741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:01.561240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.563010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.579021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1171/2332] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:01.580179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.589387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe8a2-8daf-422b-9237-ce99aa2d7d22 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.594329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.595022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.595301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.595573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.596285 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.598172 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.632906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1162/2333] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:01.637215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.647594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac459a-84a5-4c9c-8200-c19b97e5b9f0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.711038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.711712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.711998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.712273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.712983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.714989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.741162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1172/2334] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:01.746537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.757987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c804-76ec-46c0-a05b-8cdb81abccf8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.762820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.763487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.763766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.764190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.764946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.766567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.777144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1163/2335] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:01.781684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.794335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262e51-06fb-428b-be8d-1b4ef57414bd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.800862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.801548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.801830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.802104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.802892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.804517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9d1e-9afa-48b3-b7b8-208181386437 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.816318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1173/2336] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:01.820932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:01.831585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6464-8c33-43f6-9cc1-4a5e3e6d6204 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:01.837110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:01.838011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.838293 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.838620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] PATH_INFO: `/v3/projects/e1ed232ea3d344cf82fef174b65004dd/users/1f1cb753e37c4a089f5f3fb095eb30e5/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.853618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ed232ea3d344cf82fef174b65004dd, user_id=1f1cb753e37c4a089f5f3fb095eb30e5, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:01.856304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:01.876730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1164/2337] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:01 2021] PUT /identity/v3/projects/e1ed232ea3d344cf82fef174b65004dd/users/1f1cb753e37c4a089f5f3fb095eb30e5/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:01.888818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:01.889204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:01.889729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:01.920093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] MFA Rules not processed for user `1f1cb753e37c4a089f5f3fb095eb30e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:01.921336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:01.993870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1174/2338] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:01.999490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.061659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f6d85-47a2-4d2b-b8ad-84d954e55808 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.067699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.068392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.068671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.068943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.069652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.071580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.101686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1165/2339] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:01 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:02.105747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.117177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e188e-b13c-4da0-9ff0-12fbc38cc40d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.174289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.175035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.175321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.175622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.176341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.178289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.200402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1175/2340] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:02 2021] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:02.204552 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.215198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293df87-f52a-471c-b5b7-44d89ebd0346 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.221011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.221871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.222155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.222433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.223327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.225184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.236000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1166/2341] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:02.240787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.251374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d11a6-0271-4aea-a0ae-0f74183929ee admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.257130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.258010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.258282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.258581 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] PATH_INFO: `/v3/projects/87cae7668cb841e5a75c226dc17a6a98/users/b8e13fa7a2ef4f6291931e520d5bb9c8/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.275988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cae7668cb841e5a75c226dc17a6a98, user_id=b8e13fa7a2ef4f6291931e520d5bb9c8, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.278774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.295528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1176/2342] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:02 2021] PUT /identity/v3/projects/87cae7668cb841e5a75c226dc17a6a98/users/b8e13fa7a2ef4f6291931e520d5bb9c8/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:02.299478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.309591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611cea7-9030-412e-b106-05e6d1b0cbe1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.370492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.371257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.371559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.371834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.372614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.374248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8d898-6c15-4cd0-b0bf-211a248e8123 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.384994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1167/2343] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:02 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:02.389340 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.404379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c68a2-fd73-400c-85f4-5b5810b0e3cd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.412189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.413134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.413491 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.413841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] PATH_INFO: `/v3/projects/87cae7668cb841e5a75c226dc17a6a98/users/b8e13fa7a2ef4f6291931e520d5bb9c8/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.417722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cae7668cb841e5a75c226dc17a6a98, user_id=b8e13fa7a2ef4f6291931e520d5bb9c8, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.422582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.433707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1177/2344] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:02 2021] PUT /identity/v3/projects/87cae7668cb841e5a75c226dc17a6a98/users/b8e13fa7a2ef4f6291931e520d5bb9c8/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:00:02.444221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.444535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.444855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.474432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] MFA Rules not processed for user `b8e13fa7a2ef4f6291931e520d5bb9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:02.475758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:02.548194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1168/2345] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:02 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:02.558344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:02.560324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:02.631897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24f64-b05e-44c6-baea-8fce19284228 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:02.636562 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:02.637215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:02.637494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:02.637763 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:02.648507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:02.649954 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a78a-2ba3-4cda-8507-2a30fc1e5eac service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:02.660313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1178/2346] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:02 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:03.222222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:03.281782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d650721-7b97-404e-84cb-97bcc2cae7e6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:03.286273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:03.287210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:03.287489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:03.287758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] PATH_INFO: `/v3/users/1f1cb753e37c4a089f5f3fb095eb30e5` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:03.288991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1cb753e37c4a089f5f3fb095eb30e5)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:03.291010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:03.346402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1cb753e37c4a089f5f3fb095eb30e5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.354465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1cb753e37c4a089f5f3fb095eb30e5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.355560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1cb753e37c4a089f5f3fb095eb30e5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.369581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1cb753e37c4a089f5f3fb095eb30e5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.370312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1cb753e37c4a089f5f3fb095eb30e5'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.385690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1169/2347] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:03 2021] DELETE /identity/v3/users/1f1cb753e37c4a089f5f3fb095eb30e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:03.395120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:03.395431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:03.395691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:03.414427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:03.415741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:03.475879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1179/2348] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:03.485949 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:03.488316 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:03.553300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b95a-4336-4f45-9793-dd12aeb6f521 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:03.557941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:03.558693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:03.558979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:03.559247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:03.569563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:03.571059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:03.580595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1170/2349] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:03.892957 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:03.894455 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:03.906585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee26c9-8906-4edd-958e-eddab96ee47e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:03.912680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:03.914063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:03.914537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:03.914868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] PATH_INFO: `/v3/projects/e1ed232ea3d344cf82fef174b65004dd` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:03.916299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ed232ea3d344cf82fef174b65004dd)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:03.918235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:03.968970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ed232ea3d344cf82fef174b65004dd', 'request_id': 'req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.977219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ed232ea3d344cf82fef174b65004dd', 'request_id': 'req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.982521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ed232ea3d344cf82fef174b65004dd', 'request_id': 'req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.996235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] The token cache is being invalidate because project e1ed232ea3d344cf82fef174b65004dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:03.996513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.997247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:03.999345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1180/2350] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:03 2021] DELETE /identity/v3/projects/e1ed232ea3d344cf82fef174b65004dd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:04.003999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:04.014185 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1319f-e359-40e0-95a0-de2d3907c1ed service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:04.073329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:04.074234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.074541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.074826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] PATH_INFO: `/v3/users/b8e13fa7a2ef4f6291931e520d5bb9c8` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.076182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e13fa7a2ef4f6291931e520d5bb9c8)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:04.078159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:04.128356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e13fa7a2ef4f6291931e520d5bb9c8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.135012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e13fa7a2ef4f6291931e520d5bb9c8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.135730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e13fa7a2ef4f6291931e520d5bb9c8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.148908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e13fa7a2ef4f6291931e520d5bb9c8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.149569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3755fba6-2658-4d56-9028-26efb2829e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e13fa7a2ef4f6291931e520d5bb9c8'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.162866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1171/2351] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:04 2021] DELETE /identity/v3/users/b8e13fa7a2ef4f6291931e520d5bb9c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:04.493983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:04.495450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:04.508900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe9273-d0aa-4b45-ad33-216b7dfe58dc admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:04.568870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:04.569741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.570022 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.570300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] PATH_INFO: `/v3/projects/87cae7668cb841e5a75c226dc17a6a98` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.571524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cae7668cb841e5a75c226dc17a6a98)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:04.573446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:04.623448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cae7668cb841e5a75c226dc17a6a98', 'request_id': 'req-2f80284f-13f5-4b17-a043-a5a7a768e5c4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.632577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cae7668cb841e5a75c226dc17a6a98', 'request_id': 'req-2f80284f-13f5-4b17-a043-a5a7a768e5c4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.638284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cae7668cb841e5a75c226dc17a6a98', 'request_id': 'req-2f80284f-13f5-4b17-a043-a5a7a768e5c4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.650529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] The token cache is being invalidate because project 87cae7668cb841e5a75c226dc17a6a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:04.650881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.651596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-2f80284f-13f5-4b17-a043-a5a7a768e5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:04.653245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1181/2352] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:04 2021] DELETE /identity/v3/projects/87cae7668cb841e5a75c226dc17a6a98 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:04.659238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.659746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.659892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.678097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:04.679324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:04.748091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1172/2353] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:04.756838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.757123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.757396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.776925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:04.778129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:04.787628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1182/2354] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:04.792597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:04.802712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db5594-36f1-4343-9aac-1a51aadcc2bd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:04.807786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:04.808447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.808712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.808981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.809720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:04.810023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:04.811648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:04.826849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1173/2355] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:04.832142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:04.842862 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e45e0-fb1c-47e4-b282-becd7f4d3bcb None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:04.848290 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:04.848956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.849238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.849542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.850365 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:04.852332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:04.885278 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1183/2356] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:04 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:04.891077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:04.905907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fb76-53eb-4cb6-8c0f-bf9e1e5d7eb3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:04.975305 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:04.976080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:04.976464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:04.976737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:04.977453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:04.980398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:05.011308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1174/2357] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:04 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:05.018443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:05.035523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ce180-8bb2-4571-9ff5-85b323615dc2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:05.044744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:05.045812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:05.046450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:05.047038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:05.048241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:05.049907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:05.062255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1184/2358] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:05.068354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:05.083695 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279d38-6226-4364-ad8f-4425baff6d9b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:05.089967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:05.090734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:05.091010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:05.091275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:05.092016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:05.093641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac826-67f5-4271-8f64-53b4f0894821 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:05.109335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1175/2359] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:05 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:05.115695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:05.133031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34154827-c521-4ead-9119-0602542cdc95 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:05.140550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:05.142300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:05.142820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:05.143378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] PATH_INFO: `/v3/projects/0fbd42ff1d384fa8bf81b87d8caec2f9/users/7ab6abef5a7c462aa6e2c89970fa7db7/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:05.162259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbd42ff1d384fa8bf81b87d8caec2f9, user_id=7ab6abef5a7c462aa6e2c89970fa7db7, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:05.164996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:05.182274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1185/2360] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:05 2021] PUT /identity/v3/projects/0fbd42ff1d384fa8bf81b87d8caec2f9/users/7ab6abef5a7c462aa6e2c89970fa7db7/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:05.191187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81e23-f3b4-4283-8371-fd2b2c6b20fe None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:05.191698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81e23-f3b4-4283-8371-fd2b2c6b20fe None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:05.192080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81e23-f3b4-4283-8371-fd2b2c6b20fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:05.214793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-62e81e23-f3b4-4283-8371-fd2b2c6b20fe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:05.216023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-62e81e23-f3b4-4283-8371-fd2b2c6b20fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:05.311353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1176/2361] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:05.322665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:05.324837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:05.392142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe7905-99da-449c-a23d-28763f2542a0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:05.396380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:05.397093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:05.397343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:05.397623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:05.410997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:05.412713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:05.423199 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1186/2362] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:00:06.142058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.142740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.142740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.169049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] MFA Rules not processed for user `7ab6abef5a7c462aa6e2c89970fa7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:06.170281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:06.233919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1177/2363] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:06.239045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.249143 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72837f45-94d1-4da1-aaf4-ff64fc0683d7 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.254114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.254806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.255091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.255394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.256112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.258023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.284925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1187/2364] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:06 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:06.289160 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.300545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ffefc-52a4-41d6-b988-563d3b923401 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.360096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.360627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.360912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.361580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.362360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.364328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.385152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1178/2365] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:06 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:06.389272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.399995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6395af4-c213-400a-821d-9e609817ff43 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.405338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.405989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.406266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.406566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.407309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.408998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.421122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1188/2366] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:06.426297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.436569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748444f-dd49-44f8-b734-93903e61d42b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.441913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.442829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.443116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.443393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] PATH_INFO: `/v3/projects/eed336ae151d4f8b81d78227a9bf9561/users/6cf3804bd74343aea8b95039b60ab7a0/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.458465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed336ae151d4f8b81d78227a9bf9561, user_id=6cf3804bd74343aea8b95039b60ab7a0, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.461129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.475558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1179/2367] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:06 2021] PUT /identity/v3/projects/eed336ae151d4f8b81d78227a9bf9561/users/6cf3804bd74343aea8b95039b60ab7a0/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:06.479517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.490184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7e9a4-37d0-4cf7-a744-23cb6da91080 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.550232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.550967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.551357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.551638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.552377 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.553977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb229d94-760c-42f6-a8c8-3afa4b91f6b5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.565373 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1189/2368] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:06 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:06.569774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:06.581517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23746431-5288-435f-bb62-41b3b15bf3ae admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:06.586564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:06.587489 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:06.587775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:06.588049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] PATH_INFO: `/v3/projects/eed336ae151d4f8b81d78227a9bf9561/users/6cf3804bd74343aea8b95039b60ab7a0/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:06.590209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed336ae151d4f8b81d78227a9bf9561, user_id=6cf3804bd74343aea8b95039b60ab7a0, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:06.592885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:06.603416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1180/2369] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:06 2021] PUT /identity/v3/projects/eed336ae151d4f8b81d78227a9bf9561/users/6cf3804bd74343aea8b95039b60ab7a0/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:07.307925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:07.308502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:07.308616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:07.335020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] MFA Rules not processed for user `6cf3804bd74343aea8b95039b60ab7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:07.336227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:07.421272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1190/2370] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:07 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:07.432642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:07.434707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:07.491408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e8f4-99d9-4a7d-8984-af4266257200 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:07.495424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:07.496105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:07.496427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:07.496697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:07.554966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:07.556469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:07.566224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1181/2371] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:08.937880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:08.939629 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:08.952661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c80eb-df45-4880-bc93-1c4390c70283 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:08.957385 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:08.958023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:08.958295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:08.958594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:08.973619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:08.975915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14171e22-4762-4150-bebb-2d82a1e586c9 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:08.989901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1191/2372] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:08 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:19.903449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:19.905561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:19.981162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd378e-640f-4e02-a890-8e843a7ec4a1 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:19.987333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:19.988242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:19.988504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:19.988875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] PATH_INFO: `/v3/users/53f2f55e6fa54f32a5b3243dd2f8592f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:19.990175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f2f55e6fa54f32a5b3243dd2f8592f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:19.992138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:20.040990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f2f55e6fa54f32a5b3243dd2f8592f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.047817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f2f55e6fa54f32a5b3243dd2f8592f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.048487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f2f55e6fa54f32a5b3243dd2f8592f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.061224 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f2f55e6fa54f32a5b3243dd2f8592f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.061879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f2f55e6fa54f32a5b3243dd2f8592f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.076072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1182/2373] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:19 2021] DELETE /identity/v3/users/53f2f55e6fa54f32a5b3243dd2f8592f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:20.080769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.081284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.081378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.102997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:20.104296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:20.171756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1192/2374] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:20.184011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:20.186214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:20.256602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520b22-a059-42ec-8aab-db592ed23e14 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:20.260405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:20.261049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.261325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.261595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.271794 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:20.273612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c874d9-5bd7-4cea-beb5-039d21f03342 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:20.283308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1183/2375] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:20.556040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:20.558039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:20.573979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df591a-1b05-4f38-a980-9bb0c00dc560 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:20.579754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:20.580768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.581292 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.581657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] PATH_INFO: `/v3/projects/70f02c131f4d43cc97df4a637b64010d` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.583178 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f02c131f4d43cc97df4a637b64010d)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:20.585287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:20.633200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f02c131f4d43cc97df4a637b64010d', 'request_id': 'req-c75e354e-2be9-4d1f-9115-6a08651a5a02'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.641432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f02c131f4d43cc97df4a637b64010d', 'request_id': 'req-c75e354e-2be9-4d1f-9115-6a08651a5a02'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.647214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f02c131f4d43cc97df4a637b64010d', 'request_id': 'req-c75e354e-2be9-4d1f-9115-6a08651a5a02'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.658925 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] The token cache is being invalidate because project 70f02c131f4d43cc97df4a637b64010d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:20.659185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.659886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c75e354e-2be9-4d1f-9115-6a08651a5a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:20.661631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1193/2376] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:20 2021] DELETE /identity/v3/projects/70f02c131f4d43cc97df4a637b64010d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:20.667476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.667830 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.668177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.696058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:20.697558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:20.762143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1184/2377] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:20.771225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.771522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.771799 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.791955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:20.793216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:20.802258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1194/2378] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:20.806607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:20.817272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e190a-4f3f-436c-a7c3-d7795b80dfbc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:20.822280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:20.822974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.823256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.823528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.824267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:20.824574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:20.826163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:20.839660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1185/2379] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:20.843945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:20.854540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531b1b1-513b-4cb8-a1cb-d4fffdd6846e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:20.861402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:20.862083 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.862410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.862723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.863469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:20.865544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:20.899560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1195/2380] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:20 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:20.903681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:20.914882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5cde2-f5a0-49b1-9e47-e7a54b1629a5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:20.981162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:20.981863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:20.982135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:20.982410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:20.983156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:20.985125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:21.009025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1186/2381] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:20 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:21.010821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:21.025262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad9a30-4d01-4097-b974-33a695bd9ab2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:21.031876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:21.032550 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:21.032831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:21.033113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:21.033927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:21.035675 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:21.046475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1196/2382] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:21.050660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:21.061845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c518862-f2b2-431f-a7e6-315febd9dd99 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:21.068228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:21.068934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:21.069214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:21.069531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:21.070276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:21.072161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a55e1-dbf1-4616-99c2-28dbc940b7e3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:21.086891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1187/2383] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:00:21.088173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:21.099123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ad69-8710-44c7-bbc8-a3611ba585e8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:21.104456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:21.105428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:21.105698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:21.105978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] PATH_INFO: `/v3/projects/6fb1d236e6f54c138964e1e1d6d3781e/users/e70ed0b859374d4aaf887975d96ce3fe/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:21.123457 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb1d236e6f54c138964e1e1d6d3781e, user_id=e70ed0b859374d4aaf887975d96ce3fe, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:21.125503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:21.146589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1197/2384] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:21 2021] PUT /identity/v3/projects/6fb1d236e6f54c138964e1e1d6d3781e/users/e70ed0b859374d4aaf887975d96ce3fe/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:21.153605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:21.154042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:21.154375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:21.191562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] MFA Rules not processed for user `e70ed0b859374d4aaf887975d96ce3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:21.196258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:21.279271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1188/2385] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:21.290223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:21.292215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:21.367802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a72-c1cc-4286-81ca-3818ed3a5ee8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:21.377208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:21.378568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:21.378915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:21.379180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:21.388783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:21.390221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:21.399615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1198/2386] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:21 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:22.191132 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:22.193044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:22.272989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306d74-9a47-4181-a683-9417b7cb95ed None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:22.278932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:22.279819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:22.280096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:22.280374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] PATH_INFO: `/v3/users/7ab6abef5a7c462aa6e2c89970fa7db7` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:22.281682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab6abef5a7c462aa6e2c89970fa7db7)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:22.283656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:22.340715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab6abef5a7c462aa6e2c89970fa7db7'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.348538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab6abef5a7c462aa6e2c89970fa7db7'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.349480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab6abef5a7c462aa6e2c89970fa7db7'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.364201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab6abef5a7c462aa6e2c89970fa7db7'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.364966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab6abef5a7c462aa6e2c89970fa7db7'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.384526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1189/2387] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:22 2021] DELETE /identity/v3/users/7ab6abef5a7c462aa6e2c89970fa7db7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:22.560536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:22.591701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c34b4-1ca0-4e72-b3cb-5d2bc421e7c9 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:22.653261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:22.654132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:22.654428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:22.654709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] PATH_INFO: `/v3/projects/0fbd42ff1d384fa8bf81b87d8caec2f9` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:22.655964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbd42ff1d384fa8bf81b87d8caec2f9)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:22.658295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:22.709335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbd42ff1d384fa8bf81b87d8caec2f9', 'request_id': 'req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.720071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbd42ff1d384fa8bf81b87d8caec2f9', 'request_id': 'req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.726572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbd42ff1d384fa8bf81b87d8caec2f9', 'request_id': 'req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.739387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] The token cache is being invalidate because project 0fbd42ff1d384fa8bf81b87d8caec2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:22.739846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.740905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.743358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1199/2388] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:22 2021] DELETE /identity/v3/projects/0fbd42ff1d384fa8bf81b87d8caec2f9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:22.748175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:22.749962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:22.766432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71119aa2-39bf-4936-84a8-fb61c2cb49ab admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:22.823982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:22.824952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:22.825281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:22.825787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] PATH_INFO: `/v3/users/6cf3804bd74343aea8b95039b60ab7a0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:22.827249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf3804bd74343aea8b95039b60ab7a0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:22.829476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:22.882801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf3804bd74343aea8b95039b60ab7a0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.890057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf3804bd74343aea8b95039b60ab7a0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.890804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf3804bd74343aea8b95039b60ab7a0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.903421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf3804bd74343aea8b95039b60ab7a0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.907018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c992d5d4-7bf4-4f22-bdd6-7c61a077ad73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf3804bd74343aea8b95039b60ab7a0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:22.920411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1190/2389] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:22 2021] DELETE /identity/v3/users/6cf3804bd74343aea8b95039b60ab7a0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:23.116553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.118023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:23.134187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc00025-8db7-4173-8aa8-10f9eb9b07fb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.192664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.193536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.193845 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.194122 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] PATH_INFO: `/v3/projects/eed336ae151d4f8b81d78227a9bf9561` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.195418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed336ae151d4f8b81d78227a9bf9561)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.197338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.244306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed336ae151d4f8b81d78227a9bf9561', 'request_id': 'req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:23.252524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed336ae151d4f8b81d78227a9bf9561', 'request_id': 'req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:23.259231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed336ae151d4f8b81d78227a9bf9561', 'request_id': 'req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:23.272041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] The token cache is being invalidate because project eed336ae151d4f8b81d78227a9bf9561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:23.272321 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:23.273046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e8558b5a-9c57-43ce-b3a3-503cd51b21a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:23.274768 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1200/2390] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:23 2021] DELETE /identity/v3/projects/eed336ae151d4f8b81d78227a9bf9561 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:23.280632 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.281137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.281137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.299889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:23.301211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:23.365963 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1191/2391] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:23.374981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.375267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.375541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.394310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:23.395578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:23.403815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1201/2392] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:23.408563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.418761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bbb6f-f089-4066-9179-863c9ac11510 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.425343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.426280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.426647 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.426992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.428134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:23.428582 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.431096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.446355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1192/2393] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:23.450707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.460113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91ebb0-6a94-4812-a5b4-24e020a3f74b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.465174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.465843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.466101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.466371 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.467111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.469035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.496027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1202/2394] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:23 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:23.500885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.511649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275f3d4-f52d-4eeb-9237-67990333276b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.571616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.572300 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.572585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.572862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.573595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.575711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.599664 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1193/2395] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:23 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:23.603898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.614647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bc721-6a80-4034-88c6-33385c61cbc9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.619400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.620065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.620343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.620620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.621348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.622974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.634088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1203/2396] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:23.638188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.648556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fa663-ce7d-402a-90f7-4a23f62b1459 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.654281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.655008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.655294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.655570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.656325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.658589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375104a-cac0-47c8-b671-e944ca91c26b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.674084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1194/2397] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:23 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:23.675465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.687038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6e91-1de9-43e3-92db-7118e3836e69 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.694070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.695330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.695631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.695899 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] PATH_INFO: `/v3/projects/a0fc97fd46284484950f4f845d3a1648/users/480aea5f51964d7c9de2cf43922c8199/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.713374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fc97fd46284484950f4f845d3a1648, user_id=480aea5f51964d7c9de2cf43922c8199, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.716100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.730252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1204/2398] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:23 2021] PUT /identity/v3/projects/a0fc97fd46284484950f4f845d3a1648/users/480aea5f51964d7c9de2cf43922c8199/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:00:23.741789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.742120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.742493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.771355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] MFA Rules not processed for user `480aea5f51964d7c9de2cf43922c8199`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:23.772547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:23.836946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1195/2399] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:23.850211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:23.852275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:23.915544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96914e5d-8419-48fb-898a-066ec3c522b2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:23.920029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:23.920678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:23.920955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:23.921224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:23.932148 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:23.933830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9e2c-4604-4c29-9a20-b46e67829490 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:23.944277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1205/2400] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:23.964665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.027304 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103f97-7613-484a-bbd3-71cc2a5cf446 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:24.032229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:24.033111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.033392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.033669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] PATH_INFO: `/v3/users/480aea5f51964d7c9de2cf43922c8199` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.034945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480aea5f51964d7c9de2cf43922c8199)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:24.036921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:24.088784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480aea5f51964d7c9de2cf43922c8199'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.095357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480aea5f51964d7c9de2cf43922c8199'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.097163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480aea5f51964d7c9de2cf43922c8199'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.109008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480aea5f51964d7c9de2cf43922c8199'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.109816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480aea5f51964d7c9de2cf43922c8199'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.124404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1196/2401] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:23 2021] DELETE /identity/v3/users/480aea5f51964d7c9de2cf43922c8199 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:24.129201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.129516 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.129798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.147069 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:24.148267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:24.209447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1206/2402] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:24.221157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.222755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:24.292567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d21a7-a6e4-4369-bb05-13b93012b6a0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:24.296537 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:24.297169 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.297442 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.297722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.308206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:24.309713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d073052-b3bf-48b5-a055-685bbca2b8fd service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:24.319808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1197/2403] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:00:24.592804 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.595410 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:24.615708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c17d-fae4-462d-994a-512d626c18fc None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:24.621037 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:24.622108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.622362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.622749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] PATH_INFO: `/v3/projects/a0fc97fd46284484950f4f845d3a1648` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.624052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fc97fd46284484950f4f845d3a1648)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:24.626624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:24.683098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fc97fd46284484950f4f845d3a1648', 'request_id': 'req-28123fa2-65f6-43b6-8af8-ea7cf081ae21'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.691582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fc97fd46284484950f4f845d3a1648', 'request_id': 'req-28123fa2-65f6-43b6-8af8-ea7cf081ae21'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.697891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fc97fd46284484950f4f845d3a1648', 'request_id': 'req-28123fa2-65f6-43b6-8af8-ea7cf081ae21'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.711344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] The token cache is being invalidate because project a0fc97fd46284484950f4f845d3a1648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:24.711625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.713696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-28123fa2-65f6-43b6-8af8-ea7cf081ae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:24.715331 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1207/2404] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:24 2021] DELETE /identity/v3/projects/a0fc97fd46284484950f4f845d3a1648 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:24.721107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.721393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.721669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.741591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:24.742826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:24.804825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1198/2405] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:24.812849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.813136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.813413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.832873 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:24.834213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:24.842755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1208/2406] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:24.846994 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.857049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612f4eb-3ada-4a46-941d-9db7b06d2dea None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:24.862210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:24.862992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.863278 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.863603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.864548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:24.864861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:24.866453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:24.877999 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1199/2407] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:24.882956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.892116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60551f-a09b-4c9e-8051-93335c2fdc96 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:24.897034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:24.897683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:24.897965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:24.898196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:24.898961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:24.900861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:24.932832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1209/2408] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:24 2021] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:24.937719 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:24.950005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2494b2-3a46-4958-9f50-7b0037fd77e8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:25.011796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:25.012378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.012663 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.012931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.013660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:25.015608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:25.039033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1200/2409] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:24 2021] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:25.043323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:25.053971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b16153-0f6c-44e3-ba81-b8eb85d26ce9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:25.058970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:25.059623 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.059907 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.060181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.060919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:25.062551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:25.073463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1210/2410] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:25.077465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:25.090077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b4ef5-e352-463a-817e-f29e88aab155 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:25.097326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:25.098253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.098535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.098861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.099626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:25.101241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f247ac-393f-4542-b098-d90dfe7af55a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:25.111699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1201/2411] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:25.116012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:25.126545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c5830-95ad-449e-87d2-9f0ab13ecef5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:25.132577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:25.133628 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.133909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.134185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] PATH_INFO: `/v3/projects/80a134e85f204c7e8ae8d178fee6205b/users/fe69257ea4ac45b7a9b5b1486ec06adb/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.150780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a134e85f204c7e8ae8d178fee6205b, user_id=fe69257ea4ac45b7a9b5b1486ec06adb, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:25.153604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:25.168706 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1211/2412] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:25 2021] PUT /identity/v3/projects/80a134e85f204c7e8ae8d178fee6205b/users/fe69257ea4ac45b7a9b5b1486ec06adb/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:25.179887 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.180179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.180453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.210808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] MFA Rules not processed for user `fe69257ea4ac45b7a9b5b1486ec06adb`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:25.212577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:25.285510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1202/2413] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:25 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:25.295970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:25.298167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:25.359696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dddb57-d4d5-4dd0-990d-64e88f288c88 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:25.365192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:25.365851 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:25.366102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:25.366368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:25.375374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:25.376871 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f9c7-9dab-43cb-98f1-c05a2f4a62bd service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:25.385582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1212/2414] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:25 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:34.118753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:34.120271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:34.189598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d33407-b4c5-4600-b575-4cba4a39d8f8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:34.194711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:34.195662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.196012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.196377 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] PATH_INFO: `/v3/users/e70ed0b859374d4aaf887975d96ce3fe` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:34.197701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70ed0b859374d4aaf887975d96ce3fe)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:34.199862 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:34.251697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70ed0b859374d4aaf887975d96ce3fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.260260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70ed0b859374d4aaf887975d96ce3fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.260964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70ed0b859374d4aaf887975d96ce3fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.274476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70ed0b859374d4aaf887975d96ce3fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.275279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70ed0b859374d4aaf887975d96ce3fe'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.290362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1203/2415] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:34 2021] DELETE /identity/v3/users/e70ed0b859374d4aaf887975d96ce3fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:34.295499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.296040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.296123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:34.315613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:34.316928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:34.391105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1213/2416] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:34.401682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:34.403110 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:34.460431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce811-4dc9-4deb-aeab-9d9a80bf569b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:34.464100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:34.464749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.465027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.465298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:34.475016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:34.476443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88c0fc-bbf9-4d71-8a0c-6f05c6b1d8ec service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:34.486946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1204/2417] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:34.770603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:34.772098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:34.786713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62b55-78f6-479d-9585-3b17a729f580 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:34.791996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:34.794129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.794129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.794294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] PATH_INFO: `/v3/projects/6fb1d236e6f54c138964e1e1d6d3781e` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:34.795874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb1d236e6f54c138964e1e1d6d3781e)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:34.797790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:34.846609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb1d236e6f54c138964e1e1d6d3781e', 'request_id': 'req-c07b48eb-8824-4ec8-bc11-4f14c03a4596'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.854723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb1d236e6f54c138964e1e1d6d3781e', 'request_id': 'req-c07b48eb-8824-4ec8-bc11-4f14c03a4596'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.860220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb1d236e6f54c138964e1e1d6d3781e', 'request_id': 'req-c07b48eb-8824-4ec8-bc11-4f14c03a4596'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.872324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] The token cache is being invalidate because project 6fb1d236e6f54c138964e1e1d6d3781e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:34.872579 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.873168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c07b48eb-8824-4ec8-bc11-4f14c03a4596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:34.879121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1214/2418] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:34 2021] DELETE /identity/v3/projects/6fb1d236e6f54c138964e1e1d6d3781e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:34.881680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.882134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.882499 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:34.901114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:34.902416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:34.986642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1205/2419] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:34.995504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:34.995921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:34.996242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.015338 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:35.016543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:35.025540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1215/2420] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:35.030074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.040292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71728767-ccf4-4121-a7f9-200000a3a7bc None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.045025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.045686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.045965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.046237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.047024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:35.047331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.048927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.061657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1206/2421] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 12:00:35.065800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.075803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beb9d8-99c2-4282-b849-bdc92d78c1ba None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.080378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.081027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.081307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.081573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.082268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.084793 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.117079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1216/2422] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:35 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:35.122843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.133431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84ae7-62f3-4575-a95e-349095be9d9a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.189606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.190276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.190568 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.190842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.191528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.193411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.213001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1207/2423] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:35 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:35.217027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.227283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d53e23-cec9-4f3e-9c22-528241b6a93d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.232039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.232667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.232939 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.233205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.233908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.235530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.246265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1217/2424] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:35.250297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.261139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347dbd-a044-4853-888c-8e68c2ee336e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.267207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.267870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.268125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.268404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.269171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.270986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb289-7318-4330-a8b2-9b46addb3fc7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.281556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1208/2425] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:35.285863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.296780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addae39-39bb-46fd-ad37-7e78daf31b96 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.301926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.302831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.303108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.303374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] PATH_INFO: `/v3/projects/41fd8a6e324841f48c484db975797c04/users/ce79db5a34ca43af815a5f177d8cf8d3/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.317614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fd8a6e324841f48c484db975797c04, user_id=ce79db5a34ca43af815a5f177d8cf8d3, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.320285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.338945 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1218/2426] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:35 2021] PUT /identity/v3/projects/41fd8a6e324841f48c484db975797c04/users/ce79db5a34ca43af815a5f177d8cf8d3/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:35.351317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c4c3-7e49-49df-bfd5-219548562690 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.351560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c4c3-7e49-49df-bfd5-219548562690 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.351839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c4c3-7e49-49df-bfd5-219548562690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.381329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ab57c4c3-7e49-49df-bfd5-219548562690 None None] MFA Rules not processed for user `ce79db5a34ca43af815a5f177d8cf8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:35.382481 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ab57c4c3-7e49-49df-bfd5-219548562690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:35.447540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1209/2427] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:35 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:35.459892 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:35.461741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:35.522558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda89a36-ad68-48ae-be31-f81783656ce0 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:35.526323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:35.527028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:35.527307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:35.527601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:35.536572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:35.538054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:35.547780 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1219/2428] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:35 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:53.695787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:53.696410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:53.696410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:53.715460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:53.716754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:53.775195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1210/2429] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:00:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:53.824777 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:53.826391 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:53.897138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf03b8-0106-4395-b7c5-63c0367632cc service glance] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:53.902446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:53.903123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:53.903409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:53.903682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:53.911860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:53.913443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415873f3-43da-49b0-8a02-7855a6b6f0e2 service swift] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:53.922035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1220/2430] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:00:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:00:53.954054 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:53.955602 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.027230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eb1bc-16e6-41c0-a759-33586114ec8d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:54.033851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:54.034796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.035073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.035348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] PATH_INFO: `/v3/users/fe69257ea4ac45b7a9b5b1486ec06adb` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.036627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe69257ea4ac45b7a9b5b1486ec06adb)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:54.038560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:54.085029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe69257ea4ac45b7a9b5b1486ec06adb'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.091713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe69257ea4ac45b7a9b5b1486ec06adb'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.092389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe69257ea4ac45b7a9b5b1486ec06adb'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.103850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe69257ea4ac45b7a9b5b1486ec06adb'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.104490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe69257ea4ac45b7a9b5b1486ec06adb'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.119295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1211/2431] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:53 2021] DELETE /identity/v3/users/fe69257ea4ac45b7a9b5b1486ec06adb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:00:54.124440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fe90-195d-4727-a924-93f824613586 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.124640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fe90-195d-4727-a924-93f824613586 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.124914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845fe90-195d-4727-a924-93f824613586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.142920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5845fe90-195d-4727-a924-93f824613586 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:54.144189 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5845fe90-195d-4727-a924-93f824613586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.203552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1221/2432] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:00:54.214544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:54.216121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.276932 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d31ce-64fd-465d-9a84-9a0455e5ea09 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:54.280948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:54.281587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.281864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.282131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.291609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:54.293030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc0d2-3ec1-427f-89ed-50e2bbfd467d service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:54.302477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1212/2433] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:54.578755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845fe90-195d-4727-a924-93f824613586 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:54.582795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5845fe90-195d-4727-a924-93f824613586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.599309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845fe90-195d-4727-a924-93f824613586 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:54.605081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:54.606616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.606900 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.607172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] PATH_INFO: `/v3/projects/80a134e85f204c7e8ae8d178fee6205b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.608510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a134e85f204c7e8ae8d178fee6205b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:54.611144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:54.689553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a134e85f204c7e8ae8d178fee6205b', 'request_id': 'req-f16e1aa7-69cb-4a08-b27e-0765f971b53d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.698974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a134e85f204c7e8ae8d178fee6205b', 'request_id': 'req-f16e1aa7-69cb-4a08-b27e-0765f971b53d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.706806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a134e85f204c7e8ae8d178fee6205b', 'request_id': 'req-f16e1aa7-69cb-4a08-b27e-0765f971b53d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.718987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] The token cache is being invalidate because project 80a134e85f204c7e8ae8d178fee6205b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:54.719330 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.720015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f16e1aa7-69cb-4a08-b27e-0765f971b53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:54.721754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1222/2434] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:54 2021] DELETE /identity/v3/projects/80a134e85f204c7e8ae8d178fee6205b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:54.728085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.728669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.728774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.751722 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:54.752930 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.821458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1213/2435] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:54.829981 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.830568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.830568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.855474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:54.860370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:54.883136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1223/2436] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:54.887982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:54.900479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89422aaf-d628-429a-b733-a60f6f8f9305 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:54.907569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:54.908329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.908669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.909123 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.909971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:54.910277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:54.912189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:54.931836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1214/2437] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:54.934598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:54.956276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967adc85-74c0-4917-8829-90a93915fa0e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:54.961739 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:54.962405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:54.962707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:54.962980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:54.964007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:54.965902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.000982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1224/2438] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:54 2021] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:55.005860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:55.016798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1366e8-7647-4a88-88d2-653e7dcfad7b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:55.073912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:55.074612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.074893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.075164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.075859 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:55.077784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.100112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1215/2439] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:55 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:00:55.104296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:55.115549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa204-bc50-4469-a86e-1220548bd381 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:55.121353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:55.122016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.122320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.122646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.123396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:55.125059 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.136731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1225/2440] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:55.140914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:55.151935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed979bbf-c5cc-4397-b5bb-40a1a6ab9556 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:55.157269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:55.157965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.158253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.158542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.159369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:55.160991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb951-c6cd-400e-b4c5-f9acee0816a4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.171188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1216/2441] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:55.175218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:55.187215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f654b6-5ea2-4645-b990-e249a96b0349 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:55.193435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:55.194320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.194635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.194903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] PATH_INFO: `/v3/projects/f78243e9c4ec4d51a07e39bec8a14073/users/3d641a1c7e09494d86fe4a3bb88a6309/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.212711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78243e9c4ec4d51a07e39bec8a14073, user_id=3d641a1c7e09494d86fe4a3bb88a6309, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:55.215404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.230109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1226/2442] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:55 2021] PUT /identity/v3/projects/f78243e9c4ec4d51a07e39bec8a14073/users/3d641a1c7e09494d86fe4a3bb88a6309/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:55.235195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.235620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.236213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.254348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:55.255579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:55.314238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1217/2443] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:55.324535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:55.326414 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:55.388119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734fae1-6149-4d61-85dc-1ed44cb8b484 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:55.392129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:55.392786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:55.393063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:55.393333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:55.403112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:55.404471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b9fd0-27b7-4d15-9ab9-87103ee02621 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:55.414454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1227/2444] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:56.023025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:56.026427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:56.039435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e27eb-b30f-4411-b2b2-7c2562be3919 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:56.044184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:56.045064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:56.045343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:56.045798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] PATH_INFO: `/v3/users/cd9444a4c2224f3fbc8ff087f875efd9` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:56.047306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9444a4c2224f3fbc8ff087f875efd9)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:56.049257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:56.123136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9444a4c2224f3fbc8ff087f875efd9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.132088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9444a4c2224f3fbc8ff087f875efd9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.133864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9444a4c2224f3fbc8ff087f875efd9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.151027 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9444a4c2224f3fbc8ff087f875efd9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.151883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9444a4c2224f3fbc8ff087f875efd9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.171960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1218/2445] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:00:56 2021] DELETE /identity/v3/users/cd9444a4c2224f3fbc8ff087f875efd9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:56.176689 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:56.177219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:56.177347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:56.200664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:56.202431 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:56.287890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1228/2446] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:56.298742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:56.302435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:56.382655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2716b5-04a7-4026-bbed-e1a055876daa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:56.387407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:56.388151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:56.388526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:56.388872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:56.399612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:56.401460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3c3f6-21dd-45ad-bf08-eb96d02a5320 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:56.412964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1219/2447] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:00:56.777586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:56.779573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:56.806426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9c2e6-e563-481c-869f-96b0817429b6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:56.813616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:56.814928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:56.815380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:56.815795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] PATH_INFO: `/v3/projects/97f6a9f3b7564c02b297621eae94db69` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:56.832403 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f6a9f3b7564c02b297621eae94db69)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:56.834910 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:56.929336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f6a9f3b7564c02b297621eae94db69', 'request_id': 'req-55509fd9-772e-4915-8836-abb3fbfbf46e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:56.986339 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f6a9f3b7564c02b297621eae94db69', 'request_id': 'req-55509fd9-772e-4915-8836-abb3fbfbf46e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:57.007006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f6a9f3b7564c02b297621eae94db69', 'request_id': 'req-55509fd9-772e-4915-8836-abb3fbfbf46e'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:57.045985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] The token cache is being invalidate because project 97f6a9f3b7564c02b297621eae94db69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:00:57.045985 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:57.046876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-55509fd9-772e-4915-8836-abb3fbfbf46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:00:57.051646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1229/2448] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:00:56 2021] DELETE /identity/v3/projects/97f6a9f3b7564c02b297621eae94db69 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:57.057956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.058479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.058479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.087771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:57.089146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:57.200692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1220/2449] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:57.209310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.210750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.211213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.237285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:57.239049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:57.254187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1230/2450] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:57.258277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.323323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e9d91-b23a-4c7c-85b9-b4e2eaf0a6d2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.328635 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.329422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.329921 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.330477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.331487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:00:57.332127 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.333919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.368837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.369261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1221/2451] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:00:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:00:57.379074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff2fcb-cd56-4938-a250-d5dcfa7d5d9d None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.395494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.396477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.396756 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.397029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.398139 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.401568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.447559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1231/2452] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:00:57 2021] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:57.449118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.471243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a6d3e-1db6-4109-8199-1418d50758a0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.553716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.554403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.554812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.555178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.556095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.558188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.579704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1222/2453] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:00:57 2021] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:00:57.584012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.596044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85948b4-554b-4fa9-8f6d-09d1f17a6cda admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.604417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.605417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.605916 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.606280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.607172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.608886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.627522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1232/2454] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:57 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:00:57.630046 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.644120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8851a-b3ea-4250-bba5-575641641641 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.649893 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.650931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.651435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.651712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.652517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.654158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac18fc-2d4e-4734-bb6d-01b8fd58d834 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.665942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1223/2455] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:00:57 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:00:57.670095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.681050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e9a2f-b7df-40e0-9d00-e1d1bcf1ba9d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.686085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.687399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.687771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.688239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] PATH_INFO: `/v3/projects/d2c2b9a2ceeb4576a0315dddeb36c8cf/users/d0eb9dcb2fac4948b1dca02bf4d59829/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.705450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2b9a2ceeb4576a0315dddeb36c8cf, user_id=d0eb9dcb2fac4948b1dca02bf4d59829, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.708167 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.728995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1233/2456] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:00:57 2021] PUT /identity/v3/projects/d2c2b9a2ceeb4576a0315dddeb36c8cf/users/d0eb9dcb2fac4948b1dca02bf4d59829/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:00:57.741597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6fd5c-d3bf-4b95-b747-babdfb311003 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.741880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6fd5c-d3bf-4b95-b747-babdfb311003 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.742154 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6fd5c-d3bf-4b95-b747-babdfb311003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.772989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8cf6fd5c-d3bf-4b95-b747-babdfb311003 None None] MFA Rules not processed for user `d0eb9dcb2fac4948b1dca02bf4d59829`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:00:57.774233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8cf6fd5c-d3bf-4b95-b747-babdfb311003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:57.850802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1224/2457] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:00:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:00:57.873848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:00:57.875944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:00:57.961983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea996c6-8f31-4c72-af74-79353272e069 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:00:57.966205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:00:57.967337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:00:57.968045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:00:57.968475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:00:57.978583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:00:57.980315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:00:57.991606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1234/2458] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:00:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:00.634854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:00.635443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:00.635443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:00.672650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] MFA Rules not processed for user `3d641a1c7e09494d86fe4a3bb88a6309`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:00.674051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:00.789396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1225/2459] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:00.790495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:00.792611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:00.871790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36655-22f5-4929-bc71-ca89d1071415 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:00.876635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:00.877307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:00.877587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:00.877864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:00.878611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:00.880724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:00.927416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1235/2460] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:01:00 2021] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:01:00.933419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:00.949709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990a66d-e1aa-470a-b2a1-deaca2ec1133 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:01.040158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:01.040158 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:01.040477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:01.040819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:01.041810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:01.044204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:01.077909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1226/2461] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:01:00 2021] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:01.082335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:01.093788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9c7c0-2ad1-4da5-8de6-de1c5fadc9d9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:01.105857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:01.106932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:01.107382 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:01.107807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:01.109677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:01.112938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:01.132838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1236/2462] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:01 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:01:01.133665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:01.145233 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924e87-98db-42be-9205-be9b855bfaa6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:01.151588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:01.153356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:01.153705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:01.154091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] PATH_INFO: `/v3/projects/99c9026446f34700b49c48ccdec95fbe/users/20f0ef560bc9429881006be0d09d93ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:01.182899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c9026446f34700b49c48ccdec95fbe, user_id=20f0ef560bc9429881006be0d09d93ed, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:01.186306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:01.208612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1227/2463] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:01:01 2021] PUT /identity/v3/projects/99c9026446f34700b49c48ccdec95fbe/users/20f0ef560bc9429881006be0d09d93ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:01.209902 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:01.221334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0ce05-f07f-400e-b12f-e65d896c8ca7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:01.306205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:01.306924 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:01.307205 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:01.307530 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:01.308443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:01.310130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc8290-7403-428a-89e1-b9536598e884 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:01.324343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1237/2464] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:01 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:01:01.328355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:01.350112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00a937-c349-4f4b-b7a3-8c209310e15e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:01.364163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:01.365089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:01.365351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:01.365667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] PATH_INFO: `/v3/projects/99c9026446f34700b49c48ccdec95fbe/users/20f0ef560bc9429881006be0d09d93ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:01.375915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c9026446f34700b49c48ccdec95fbe, user_id=20f0ef560bc9429881006be0d09d93ed, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:01.378755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:01.397005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1228/2465] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:01:01 2021] PUT /identity/v3/projects/99c9026446f34700b49c48ccdec95fbe/users/20f0ef560bc9429881006be0d09d93ed/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:08.938128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7f11-b1d4-4b76-b47b-eb5016f11711 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:08.938766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7f11-b1d4-4b76-b47b-eb5016f11711 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:08.938861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7f11-b1d4-4b76-b47b-eb5016f11711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:08.988475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0c4f7f11-b1d4-4b76-b47b-eb5016f11711 None None] MFA Rules not processed for user `20f0ef560bc9429881006be0d09d93ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:08.990539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0c4f7f11-b1d4-4b76-b47b-eb5016f11711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:09.133593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1238/2466] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:08 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:09.144876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:09.146666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:09.329428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732efe8-02ed-464a-92b1-a3d9b75e7f0b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:09.336292 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:09.337038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:09.337751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:09.337991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:09.419498 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:09.421228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:09.431256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1229/2467] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:10.971008 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85ec4-ad85-420d-b2f6-397ec07d6a6f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:10.971462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85ec4-ad85-420d-b2f6-397ec07d6a6f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:10.971605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85ec4-ad85-420d-b2f6-397ec07d6a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:11.012029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6be85ec4-ad85-420d-b2f6-397ec07d6a6f None None] MFA Rules not processed for user `3d641a1c7e09494d86fe4a3bb88a6309`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:11.013758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6be85ec4-ad85-420d-b2f6-397ec07d6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:11.014279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:11.025064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1239/2468] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:11.236620 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfba4a-893a-4f73-8d1c-762aef4c4a88 service nova] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:11.251403 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:11.252578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:11.253772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:11.254220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] PATH_INFO: `/v3/users/d0eb9dcb2fac4948b1dca02bf4d59829` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:11.260596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0eb9dcb2fac4948b1dca02bf4d59829)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:11.263662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:11.398428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0eb9dcb2fac4948b1dca02bf4d59829'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:11.426125 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0eb9dcb2fac4948b1dca02bf4d59829'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:11.426961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0eb9dcb2fac4948b1dca02bf4d59829'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:11.465449 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0eb9dcb2fac4948b1dca02bf4d59829'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:11.467081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0eb9dcb2fac4948b1dca02bf4d59829'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:11.526018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1230/2469] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:01:11 2021] DELETE /identity/v3/users/d0eb9dcb2fac4948b1dca02bf4d59829 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:01:11.530485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:11.531003 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:11.531437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:11.639407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:11.641927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:11.768697 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1240/2470] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:11.783118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:11.785055 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:11.925338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd027-4d17-458b-8a9f-55d98328a0ff admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:11.933482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:11.934680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:11.935306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:11.935447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:11.951422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:11.954223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176276fd-1c64-4b9e-b577-db4e24e6012a service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:11.992918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1231/2471] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:12.851086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:12.854426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:12.883125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664fcd-f614-474a-8635-008e9bda7f7b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:12.898131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:12.899216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:12.901721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:12.902289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] PATH_INFO: `/v3/projects/d2c2b9a2ceeb4576a0315dddeb36c8cf` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:12.904476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2b9a2ceeb4576a0315dddeb36c8cf)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:12.911206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.003226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2b9a2ceeb4576a0315dddeb36c8cf', 'request_id': 'req-ec9264b1-7d66-4180-a838-a045f256c8a5'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:13.012610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2b9a2ceeb4576a0315dddeb36c8cf', 'request_id': 'req-ec9264b1-7d66-4180-a838-a045f256c8a5'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:13.031190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2b9a2ceeb4576a0315dddeb36c8cf', 'request_id': 'req-ec9264b1-7d66-4180-a838-a045f256c8a5'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:13.047879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] The token cache is being invalidate because project d2c2b9a2ceeb4576a0315dddeb36c8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:01:13.049370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:13.050087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ec9264b1-7d66-4180-a838-a045f256c8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:13.051786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1241/2472] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:01:12 2021] DELETE /identity/v3/projects/d2c2b9a2ceeb4576a0315dddeb36c8cf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:13.059148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.061010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.061395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.115670 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:13.116935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:13.205116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1232/2473] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:01:13.212722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.213094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.213434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.234961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:13.236528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:13.246131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1242/2474] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:01:13.250624 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.260486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020fb0-6e9b-44b9-a348-5b80dd2ca83b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.265210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.265895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.266174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.266450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.267229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:01:13.267535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.269152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.281769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1233/2475] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:01:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:01:13.286187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.295620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c197118-61bc-4304-bdd0-d7318e75fed0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.304865 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.305867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.306210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.306489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.307611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.309720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.343157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1243/2476] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:01:13 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:13.347429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.359325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907eaa2-b46d-4c23-a1cf-e2727fadc3ce admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.428180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.428846 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.429280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.429700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.430769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.432836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.460454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1234/2477] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:01:13 2021] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:13.462042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.474757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0459c9-9854-4340-b085-0cb5e1be447d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.479553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.480238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.480792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.480792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.481641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.483345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.518610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.521879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1244/2478] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:01:13.533562 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba7b0-4c47-461e-b6e0-d6a11df63362 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.540195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.541636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.542144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.542679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.543706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.545815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145144f-c50b-41d6-a273-0d70a8ee8c95 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.557731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1235/2479] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:13 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:01:13.563757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.581294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bcb3b-176b-4c2e-ba72-14a9aacd342b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.606618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.607570 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.607864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.608150 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] PATH_INFO: `/v3/projects/656fb5fa69a64dd49ed36532dfa2ef18/users/26fed87e1ecb47478db1cffa6d53f416/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.649120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=656fb5fa69a64dd49ed36532dfa2ef18, user_id=26fed87e1ecb47478db1cffa6d53f416, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.651963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.677639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1245/2480] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:01:13 2021] PUT /identity/v3/projects/656fb5fa69a64dd49ed36532dfa2ef18/users/26fed87e1ecb47478db1cffa6d53f416/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:01:13.683291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bfb0-a2ff-4092-9961-702721ed4a2d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.683607 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bfb0-a2ff-4092-9961-702721ed4a2d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.684063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bfb0-a2ff-4092-9961-702721ed4a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.706872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9484bfb0-a2ff-4092-9961-702721ed4a2d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:13.708277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9484bfb0-a2ff-4092-9961-702721ed4a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:13.774671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1236/2481] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:13.783147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:13.784923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:13.850230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e485591-6dee-42c7-b1b9-41515cab8a2f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:13.854492 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:13.855263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:13.855548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:13.855823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:13.866067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:13.868048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:13.878483 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1246/2482] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:14.850440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd57d01-7a1f-4e00-be1b-9abb4693522d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:14.851451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd57d01-7a1f-4e00-be1b-9abb4693522d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:14.851915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd57d01-7a1f-4e00-be1b-9abb4693522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:14.902174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-bdd57d01-7a1f-4e00-be1b-9abb4693522d None None] MFA Rules not processed for user `26fed87e1ecb47478db1cffa6d53f416`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:14.903853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bdd57d01-7a1f-4e00-be1b-9abb4693522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:15.006743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1237/2483] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:15.024532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:15.026203 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:15.092051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856274b9-9237-4448-85f9-b9268b32ebb1 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:15.095882 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:15.096651 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:15.097007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:15.097344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:15.113858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:15.115384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603883ec-b34e-44ba-ae31-a41a65aebc72 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:15.126329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1247/2484] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:15 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:16.559639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:16.560343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:16.560343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:16.585559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] MFA Rules not processed for user `26fed87e1ecb47478db1cffa6d53f416`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:16.587666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:16.597051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1238/2485] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:37.640286 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fdc9-29f7-44e9-b04b-593528f952d8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:37.640834 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fdc9-29f7-44e9-b04b-593528f952d8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:37.640960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88fdc9-29f7-44e9-b04b-593528f952d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:37.671395 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1f88fdc9-29f7-44e9-b04b-593528f952d8 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:37.672640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f88fdc9-29f7-44e9-b04b-593528f952d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:37.731582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1248/2486] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:01:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:37.748784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:37.750612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:37.846387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfac676-18d3-469d-b560-e9c0197032a8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:37.851428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:37.852071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:37.852345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:37.852639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:37.863297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:37.864917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:37.873918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1239/2487] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:01:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:01:38.743405 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:38.744891 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:38.745614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:38.771026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:38.772519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:38.783606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1249/2488] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:01:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:38.799714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:38.818068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77992f-5e8c-4881-8be3-c9d0437c380e service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:38.830758 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:38.833924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:38.835806 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:38.837068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:38.855665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:38.859157 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:38.877149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1240/2489] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:01:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:01:41.181426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:41.182976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:41.225024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890741ca-c23a-4b36-8510-566ff9fab27e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:41.232415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:41.233652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:41.234092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:41.234553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] PATH_INFO: `/v3/users/b9397ca2bd8a4195a2c54dbb1a97ddf0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:41.236588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9397ca2bd8a4195a2c54dbb1a97ddf0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:41.238782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:41.321645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9397ca2bd8a4195a2c54dbb1a97ddf0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.329688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9397ca2bd8a4195a2c54dbb1a97ddf0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.330481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9397ca2bd8a4195a2c54dbb1a97ddf0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.342021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9397ca2bd8a4195a2c54dbb1a97ddf0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.384067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9397ca2bd8a4195a2c54dbb1a97ddf0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.407888 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1250/2490] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:01:41 2021] DELETE /identity/v3/users/b9397ca2bd8a4195a2c54dbb1a97ddf0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:41.680883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:41.695186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fff8-7d87-4901-8d21-24c1b78ffb47 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:41.756957 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:41.758140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:41.758430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:41.758772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] PATH_INFO: `/v3/projects/7ca5ca45c6494bff9a1a66863948f839` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:41.760165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca5ca45c6494bff9a1a66863948f839)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:41.762291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:41.811021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca5ca45c6494bff9a1a66863948f839', 'request_id': 'req-3516af11-66a6-4ee4-a196-086cc41633b9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.819774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca5ca45c6494bff9a1a66863948f839', 'request_id': 'req-3516af11-66a6-4ee4-a196-086cc41633b9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.825768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca5ca45c6494bff9a1a66863948f839', 'request_id': 'req-3516af11-66a6-4ee4-a196-086cc41633b9'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.837886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] The token cache is being invalidate because project 7ca5ca45c6494bff9a1a66863948f839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:01:41.838088 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.838701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:41.840291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1241/2491] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:01:41 2021] DELETE /identity/v3/projects/7ca5ca45c6494bff9a1a66863948f839 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:49.693208 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:49.695151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:49.792887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97387c6e-d685-4c6b-9261-e3272ca42cd7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:49.853620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:49.854269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:49.854576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:49.854854 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:49.856798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:49.868434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:49.870048 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccce5c-8b4a-4e73-ba58-e892bd615f6b service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:49.880229 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1251/2492] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:55.140919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:55.142413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.207935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516af11-66a6-4ee4-a196-086cc41633b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:55.221189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:55.222207 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.222610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.223182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] PATH_INFO: `/v3/users/ce79db5a34ca43af815a5f177d8cf8d3` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.224848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce79db5a34ca43af815a5f177d8cf8d3)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:55.228566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:55.256001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a542b-a61b-4ced-ad09-e7f7a25889bf None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.256545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a542b-a61b-4ced-ad09-e7f7a25889bf None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.256545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a542b-a61b-4ced-ad09-e7f7a25889bf None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.258700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1252/2493] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 12:01:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 12:01:55.266233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.266715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.266898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.289053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce79db5a34ca43af815a5f177d8cf8d3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.296288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce79db5a34ca43af815a5f177d8cf8d3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.297880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce79db5a34ca43af815a5f177d8cf8d3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.312331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce79db5a34ca43af815a5f177d8cf8d3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.313906 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-13b43fc1-155c-443f-9cad-23a38095426e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce79db5a34ca43af815a5f177d8cf8d3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.333492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1242/2494] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:01:55 2021] DELETE /identity/v3/users/ce79db5a34ca43af815a5f177d8cf8d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:55.339035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.339035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.339270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.352988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:55.354852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.358238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:55.359657 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.425496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1243/2495] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:01:55.436669 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:55.438859 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.455824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1253/2496] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 12:01:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:55.468657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:55.470534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.502020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25acf-6eb0-4b0d-99f1-2dd41ea5157d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:55.505626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:55.506337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.506572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.507530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.515873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:55.517294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc80a3a-297c-40fa-aa74-c74500451a4d service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:55.526612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1244/2497] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:55.527574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548898c3-e128-4770-88a1-e868fbff47c0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:55.531318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:55.532067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.532432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.532774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.544277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:55.545812 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de7f18-049b-4579-87c4-f1c7984b27e7 service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:55.556589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1254/2498] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:55.629855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.630144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.630418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.632288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1245/2499] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 12:01:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 12:01:55.637955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.638332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.638824 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.657712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:55.658965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.668478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1255/2500] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 12:01:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:55.681218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:55.683243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.698119 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725018-e91d-4763-9b7c-1e73db99ab30 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:55.702199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:55.702891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.703166 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.703432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.711205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:55.712702 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599f69-976d-4c6b-80ca-60fd4b5b338d service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:55.721077 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1246/2501] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:55.808696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:55.810126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:55.827451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2fc5d-59c4-4fd6-91e0-0c15460bb522 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:55.832245 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:55.833107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.833392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.833663 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] PATH_INFO: `/v3/projects/41fd8a6e324841f48c484db975797c04` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.835029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fd8a6e324841f48c484db975797c04)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:55.843343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:55.900129 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fd8a6e324841f48c484db975797c04', 'request_id': 'req-45e0e933-de8f-4713-a9e1-6389e8f56b62'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.909915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fd8a6e324841f48c484db975797c04', 'request_id': 'req-45e0e933-de8f-4713-a9e1-6389e8f56b62'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.917110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fd8a6e324841f48c484db975797c04', 'request_id': 'req-45e0e933-de8f-4713-a9e1-6389e8f56b62'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.930375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] The token cache is being invalidate because project 41fd8a6e324841f48c484db975797c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:01:55.930716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.931388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-45e0e933-de8f-4713-a9e1-6389e8f56b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:55.932949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1256/2502] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:01:55 2021] DELETE /identity/v3/projects/41fd8a6e324841f48c484db975797c04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:55.938790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:55.939076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:55.939353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:55.959998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:55.962029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:56.025509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1247/2503] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:56.033416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.033800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.034163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.053351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:56.054718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:56.063564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1257/2504] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:56.067911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.077545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549801c-f316-40c0-9850-ac190ffc3fd4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.082350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.083047 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.083322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.083599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.084339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:01:56.084648 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.086232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.105733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1248/2505] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:01:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:01:56.111084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.123315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329bbe-7a4c-4052-8da2-20700406650e None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.129193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.129878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.130156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.130433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.131180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.133142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.161734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1258/2506] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:01:56 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:56.166117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.176733 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f4305-7292-4e65-b3fb-a6732af7fdbf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.243346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.244057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.244335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.244606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.245476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.247434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.269884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1249/2507] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:01:56 2021] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:56.274443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.285060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e3c4-7476-4804-9de6-93e9380b2474 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.290119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.290822 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.291096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.291368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.292243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.293894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.306210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1259/2508] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:01:56.310384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.320354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a056-8d7e-471b-87a8-503b4515f137 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.325312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.325982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.326262 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.326572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.327356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.328953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90b305-a6bd-4239-9066-789b895cb1d5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.339252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1250/2509] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:01:56.343364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.355109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d9d-8d52-49c3-a91c-fba4e3e3ee7b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.360138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.361601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.361977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.362345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] PATH_INFO: `/v3/projects/f0398a256dc04cb0ad6eacb85b695ea7/users/6dd92cad90df435cbc89bd654db4b00d/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.378555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0398a256dc04cb0ad6eacb85b695ea7, user_id=6dd92cad90df435cbc89bd654db4b00d, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.381227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.395072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1260/2510] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:01:56 2021] PUT /identity/v3/projects/f0398a256dc04cb0ad6eacb85b695ea7/users/6dd92cad90df435cbc89bd654db4b00d/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:56.406250 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.406535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.406861 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.434683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] MFA Rules not processed for user `6dd92cad90df435cbc89bd654db4b00d`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:56.435946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:56.506203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1251/2511] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:56.517686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.519792 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:56.653809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229db61-e0a8-4856-a190-25596759b914 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.657577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.658230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.658532 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.658820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.667499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.668946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfff38-f364-4938-aa04-fdb04252b7cf service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.677868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1261/2512] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:56 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:56.704238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.766732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc4e1f-06ff-49bd-8237-9e35503257da None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:56.771875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:56.772754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.773036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.773309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] PATH_INFO: `/v3/users/6dd92cad90df435cbc89bd654db4b00d` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.774697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd92cad90df435cbc89bd654db4b00d)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:56.776633 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:56.830928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd92cad90df435cbc89bd654db4b00d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:56.838081 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd92cad90df435cbc89bd654db4b00d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:56.838804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd92cad90df435cbc89bd654db4b00d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:56.850741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd92cad90df435cbc89bd654db4b00d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:56.851420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd92cad90df435cbc89bd654db4b00d'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:56.866163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1252/2513] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:01:56 2021] DELETE /identity/v3/users/6dd92cad90df435cbc89bd654db4b00d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:56.871329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:56.871614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:56.871887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:56.889716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:56.890952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:56.951043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1262/2514] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:56.961665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:56.963479 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:57.021945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d76dc1-486f-411e-bc73-4fc094f6a7e6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.026541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.027211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.027493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.027765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.044204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.045659 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555de94a-9ad6-4d95-8f5f-1e0ba34aa4ed service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.056527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1253/2515] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:57.322874 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.324962 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:57.338877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be673e71-8851-4fd6-b853-9a81c46d5120 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.344496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.345541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.345926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.346537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] PATH_INFO: `/v3/projects/f0398a256dc04cb0ad6eacb85b695ea7` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.348422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0398a256dc04cb0ad6eacb85b695ea7)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.350585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.406046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0398a256dc04cb0ad6eacb85b695ea7', 'request_id': 'req-f85b6018-dc43-4757-9a9c-f650a63069b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:57.415400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0398a256dc04cb0ad6eacb85b695ea7', 'request_id': 'req-f85b6018-dc43-4757-9a9c-f650a63069b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:57.421661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0398a256dc04cb0ad6eacb85b695ea7', 'request_id': 'req-f85b6018-dc43-4757-9a9c-f650a63069b4'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:57.433352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] The token cache is being invalidate because project f0398a256dc04cb0ad6eacb85b695ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:01:57.433638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:57.435076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-f85b6018-dc43-4757-9a9c-f650a63069b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:01:57.437236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1263/2516] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:01:57 2021] DELETE /identity/v3/projects/f0398a256dc04cb0ad6eacb85b695ea7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:57.442594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.443448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.443734 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.463750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:57.465104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:57.528136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1254/2517] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:57.536105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.536392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.536668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.555931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:57.557086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:57.567667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1264/2518] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:57.572343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.582890 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995b751-2f58-4328-8adf-67e93685af19 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.588004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.588792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.589136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.589350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.590366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:01:57.590641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.592351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.606560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1255/2519] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:01:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:01:57.609828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.619593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ba644-b9bc-46b4-b6ee-2e3d2784ea8c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.624870 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.625567 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.625884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.626192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.626941 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.628831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.664336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1265/2520] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:01:57 2021] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:01:57.668613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.679424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15459f0-a887-42eb-a550-cb40d25903cf admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.743460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.744324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.744621 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.744936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.745731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.747939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.777898 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1256/2521] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:01:57 2021] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:01:57.781724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.793705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21f16e-ee24-4595-92ee-4540fa42b68a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.798594 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.799279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.799561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.799837 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.800586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.802232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.816123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1266/2522] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:01:57.817488 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.829108 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53191545-2558-4b7c-9f4a-dff40c45e08f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.834991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.835668 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.835955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.836317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.837074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.838791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d62da6-f817-4875-abd7-a4f6e2170d00 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.852638 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1257/2523] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:01:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:01:57.854796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:57.866731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e6fb-a173-4952-a476-a7e65c25f49d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:57.873738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:57.874993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.875376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.875742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] PATH_INFO: `/v3/projects/f706943dd817469097f00b335d5f7a7b/users/ab44686fc5e84aa38b998fd8a9feef44/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.896484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f706943dd817469097f00b335d5f7a7b, user_id=ab44686fc5e84aa38b998fd8a9feef44, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:57.900242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:57.917068 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1267/2524] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:01:57 2021] PUT /identity/v3/projects/f706943dd817469097f00b335d5f7a7b/users/ab44686fc5e84aa38b998fd8a9feef44/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:01:57.929171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc419df-83be-4065-b4c4-ae9b4f86f3bc None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:57.929581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc419df-83be-4065-b4c4-ae9b4f86f3bc None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:57.930078 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc419df-83be-4065-b4c4-ae9b4f86f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:57.975042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-dcc419df-83be-4065-b4c4-ae9b4f86f3bc None None] MFA Rules not processed for user `ab44686fc5e84aa38b998fd8a9feef44`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:57.977969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-dcc419df-83be-4065-b4c4-ae9b4f86f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:58.047135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1258/2525] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:01:57 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:58.058928 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:58.060831 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:58.124079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c565f7-1d2e-45c4-81fe-e8e7e59c3cc6 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:58.128384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:58.129095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:58.129374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:58.129643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:58.138893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:58.140716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:58.150496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1268/2526] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:01:58 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:01:59.212800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:59.213353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:59.213353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:59.231597 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:01:59.232796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:59.290791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1259/2527] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:01:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:01:59.313281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:01:59.314733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:01:59.401958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6d8c-9115-4023-a166-f3e1a338a0b4 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:01:59.407106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:01:59.407843 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:01:59.408255 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:01:59.408544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:01:59.417601 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:01:59.419246 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512896f0-75fc-4b67-ba5a-e08bf76c4775 service swift] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:01:59.427220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1269/2528] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:01:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:02:08.309281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:02:08.394630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844ffd-74f8-4277-a0e1-ad0f60faf2e1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:02:08.402868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:02:08.403872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:08.404134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:08.404392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] PATH_INFO: `/v3/users/ab44686fc5e84aa38b998fd8a9feef44` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:08.405730 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab44686fc5e84aa38b998fd8a9feef44)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:02:08.407791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:02:08.474770 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab44686fc5e84aa38b998fd8a9feef44'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:08.483570 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab44686fc5e84aa38b998fd8a9feef44'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:08.484433 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab44686fc5e84aa38b998fd8a9feef44'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:08.501767 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab44686fc5e84aa38b998fd8a9feef44'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:08.502867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab44686fc5e84aa38b998fd8a9feef44'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:08.525731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1260/2529] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:02:08 2021] DELETE /identity/v3/users/ab44686fc5e84aa38b998fd8a9feef44 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:02:08.530772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:08.531313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:08.531416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:08.552545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:02:08.557707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:08.635500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1270/2530] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:02:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:02:08.648151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:02:08.650363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:08.721012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86847a-08d7-4355-bbd7-26c43f09d565 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:02:08.724886 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:02:08.725545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:08.725826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:08.726099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:08.739389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:02:08.742052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:02:08.754023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1261/2531] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:02:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:02:09.036556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:02:09.038005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:09.051470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98428-20cb-44ba-8eb0-f875b4056c80 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:02:09.056380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:02:09.057418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:09.057701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:09.057971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] PATH_INFO: `/v3/projects/f706943dd817469097f00b335d5f7a7b` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:09.059219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f706943dd817469097f00b335d5f7a7b)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:02:09.061215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:02:09.112240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f706943dd817469097f00b335d5f7a7b', 'request_id': 'req-baaaa02a-9a70-48a9-9cc8-d994a86a1648'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:09.120690 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f706943dd817469097f00b335d5f7a7b', 'request_id': 'req-baaaa02a-9a70-48a9-9cc8-d994a86a1648'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:09.126475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f706943dd817469097f00b335d5f7a7b', 'request_id': 'req-baaaa02a-9a70-48a9-9cc8-d994a86a1648'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:09.138186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] The token cache is being invalidate because project f706943dd817469097f00b335d5f7a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:02:09.138468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:09.139140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-baaaa02a-9a70-48a9-9cc8-d994a86a1648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:02:09.140691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1271/2532] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:02:09 2021] DELETE /identity/v3/projects/f706943dd817469097f00b335d5f7a7b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:02:24.787541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:02:24.789120 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:24.801035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a2dc2-cc05-4d2f-98a5-f3e9a9683eb5 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:02:24.851213 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:02:24.851876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:24.852183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:24.852427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:24.854637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:24.926558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:02:24.928062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:02:24.937819 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1262/2533] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:02:24 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:02:31.208727 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d04d-0115-4677-a019-a12978d8e3b7 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:31.209259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d04d-0115-4677-a019-a12978d8e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:31.209259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602d04d-0115-4677-a019-a12978d8e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:31.258057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6602d04d-0115-4677-a019-a12978d8e3b7 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:02:31.259316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6602d04d-0115-4677-a019-a12978d8e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:31.325009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1272/2534] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:02:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:02:31.338093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:02:31.339567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:02:31.447775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f8455-5af0-4bb5-bed9-5d53181ed9c2 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:02:31.453593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:02:31.454245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:02:31.454540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:02:31.454831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:02:31.463405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:02:31.464992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:02:31.472923 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1263/2535] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:02:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:03:10.703729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:10.704272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:10.704272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:10.722901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] MFA Rules not processed for user `26fed87e1ecb47478db1cffa6d53f416`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:10.724079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:10.786694 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1273/2536] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:23.868958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:23.870405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:23.945815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403164-8d6d-4072-b55d-3f1c55b4f4c0 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:23.951272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:23.952163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:23.952438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:23.952828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] PATH_INFO: `/v3/users/3f41f3bd3c1142aca50069a45a26aaaa` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:23.954248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f41f3bd3c1142aca50069a45a26aaaa)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:23.955943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.004959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f41f3bd3c1142aca50069a45a26aaaa'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.011816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f41f3bd3c1142aca50069a45a26aaaa'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.012515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f41f3bd3c1142aca50069a45a26aaaa'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.023769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f41f3bd3c1142aca50069a45a26aaaa'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.024434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-7322c4e1-b7fa-4163-9c81-6918fb5925e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f41f3bd3c1142aca50069a45a26aaaa'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.038978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1264/2537] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:03:23 2021] DELETE /identity/v3/users/3f41f3bd3c1142aca50069a45a26aaaa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:03:24.218991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.233128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4be65-d0e3-4b06-9b3f-52ef3c951d7a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.298818 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.299703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.299978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.300242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] PATH_INFO: `/v3/projects/ec59363a116e4c37832626c6add07f04` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.301528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec59363a116e4c37832626c6add07f04)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.303517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.357370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec59363a116e4c37832626c6add07f04', 'request_id': 'req-ef4cf221-7018-47e6-815d-a51572b8964f'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.366186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec59363a116e4c37832626c6add07f04', 'request_id': 'req-ef4cf221-7018-47e6-815d-a51572b8964f'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.372174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec59363a116e4c37832626c6add07f04', 'request_id': 'req-ef4cf221-7018-47e6-815d-a51572b8964f'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.383279 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] The token cache is being invalidate because project ec59363a116e4c37832626c6add07f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:03:24.383564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.384696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ef4cf221-7018-47e6-815d-a51572b8964f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:03:24.386369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1274/2538] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:03:24 2021] DELETE /identity/v3/projects/ec59363a116e4c37832626c6add07f04 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:03:24.392347 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.392634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.392948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.411973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:24.413188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:24.474261 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1265/2539] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:24.485304 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.485614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.485868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.506081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:24.507328 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:24.516723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1275/2540] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:24.522242 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.532526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dfa75-036a-4f20-8346-9420cdacbbdf None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.537855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.538530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.538820 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.539083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.539825 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:03:24.540219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.542031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.553718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1266/2541] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:03:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:03:24.559364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.569481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbefa9-b27e-4dcd-a07e-8d19f290a1dd None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.574266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.575038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.575301 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.575563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.576287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.578175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.605262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1276/2542] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:03:24 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:03:24.612009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.624394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47fdb5-c514-4ab3-a3b0-e580102596c8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.687490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.688183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.688599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.688883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.689630 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.691637 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.716661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1267/2543] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:03:24 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:03:24.717887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.728263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8809a-46e4-4f03-9d9b-72fb0175f521 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.733259 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.733922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.734235 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.734852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.735593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.737185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.748001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1277/2544] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:03:24.752220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.762376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f1225-14f6-49ed-916f-755a46e68f50 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.767192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.767965 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.768255 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.768558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.769341 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.771573 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ad9e-49b2-48fc-aa55-a93002533567 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.786885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1268/2545] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:03:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:03:24.788094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.798751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52e283-9b71-4fd1-b3a2-b92031a685ca admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:24.803559 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:24.804524 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.804876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.805174 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] PATH_INFO: `/v3/projects/83a1e536ed4249adb353b71e8bf03cfd/users/a351cbc96e894a03906076d2652272a3/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.820348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a1e536ed4249adb353b71e8bf03cfd, user_id=a351cbc96e894a03906076d2652272a3, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:24.823425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:24.838100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1278/2546] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:03:24 2021] PUT /identity/v3/projects/83a1e536ed4249adb353b71e8bf03cfd/users/a351cbc96e894a03906076d2652272a3/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:03:24.843254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47afd9-ca24-4152-aaea-3e00caec824b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:24.843542 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47afd9-ca24-4152-aaea-3e00caec824b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:24.843818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47afd9-ca24-4152-aaea-3e00caec824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:24.862204 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6f47afd9-ca24-4152-aaea-3e00caec824b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:24.863421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6f47afd9-ca24-4152-aaea-3e00caec824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:24.925282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1269/2547] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:24.935563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:24.937585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:25.000955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367d356-1632-4315-8498-7b29381c3b30 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:25.005452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:25.006112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:25.006392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:25.006688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:25.018372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:25.019839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:25.029640 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1279/2548] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:29.143323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2d44-2cab-41d7-b62f-998f6919a026 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:29.143912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2d44-2cab-41d7-b62f-998f6919a026 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:29.143912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2d44-2cab-41d7-b62f-998f6919a026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:29.174831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-58ee2d44-2cab-41d7-b62f-998f6919a026 None None] MFA Rules not processed for user `a351cbc96e894a03906076d2652272a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:29.176131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-58ee2d44-2cab-41d7-b62f-998f6919a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:29.248900 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1270/2549] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:29.261000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:29.262561 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:29.339537 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7488a7e-312f-4fcb-9c89-8f8185eabad7 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:29.345302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:29.349773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:29.349773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:29.349773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:29.358425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:29.360506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:29.372990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1280/2550] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:30.976063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:30.976848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:30.977159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:30.997462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] MFA Rules not processed for user `a351cbc96e894a03906076d2652272a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:30.999035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:31.006491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1271/2551] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:31.047747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:31.050456 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:31.148794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45322f54-ee16-4773-9909-356e4dd937c6 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:31.154226 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:31.154781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:31.155063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:31.155332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:31.157201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:31.179228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:31.180673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:31.193714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1281/2552] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:03:31.849539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:31.853651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:31.873231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b504-76c1-4e14-9bbb-eaff3005a207 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:31.884176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:31.886030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:31.886311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:31.886625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:31.891848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:31.913556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:31.915042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:31.929062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1272/2553] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:40.176796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:40.191088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b86a-9e24-46b3-b1e0-c805dedd8be6 service glance] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:40.198554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:40.199898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:40.200184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:40.200466 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:40.202671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:40.279462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:40.281092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:40.290716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1282/2554] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:40 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:42.909257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:42.921535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee126a-1606-4f47-8270-a7549b34df17 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:42.926136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:42.926821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:42.927093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:42.927366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:42.929512 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:42.939833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:42.941254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88082463-83ca-476d-89d8-c971a5df469e service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:42.950023 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1273/2555] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:52.311964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:52.313677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:52.334005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:52.334579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:52.334579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:52.348211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f74e6-b6c6-4c0f-a683-ffd072dceb7d service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:52.359089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:52.360619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:52.361128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:52.362183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:52.366116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:52.379510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] MFA Rules not processed for user `804530daa2704fcdb1fef91615b62c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:52.380705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:52.387298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:52.389302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d0a44-1422-4c60-bb8c-8ade3753941b service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:52.391916 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1274/2556] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:03:52 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:03:52.402847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1283/2557] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:52.800026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:52.813614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb4ede-ccb1-46b7-9f77-308e99752841 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:52.818298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:52.818982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:52.819265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:52.819545 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:52.821713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:52.832948 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:52.834396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a4e7-515e-412d-b50d-d1e1b6d4d3cd service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:52.843404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1275/2558] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:03:53.167173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c51-2797-433a-8301-2f61aecc5007 None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:53.167509 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c51-2797-433a-8301-2f61aecc5007 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:53.167786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c51-2797-433a-8301-2f61aecc5007 None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:53.170080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1284/2559] 10.222.0.65 () {54 vars in 960 bytes} [Thu Dec 23 12:03:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 12:03:53.175866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:53.176237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:53.176507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:53.213346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] MFA Rules not processed for user `c6966386b0f049b69806233e9a0157ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:03:53.214636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:53.277995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1276/2560] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Dec 23 12:03:53 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:03:53.286230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08c51-2797-433a-8301-2f61aecc5007 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:03:53.302112 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08c51-2797-433a-8301-2f61aecc5007 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:03:53.308317 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:03:53.308953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:03:53.309277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:03:53.309553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:03:53.311630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:03:53.323159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:03:53.324742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:03:53.334765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1285/2561] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:03:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:04:09.330439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:04:09.344394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469850-e589-474a-ad3f-d0c8f85cc996 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:04:09.367967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:04:09.368745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:04:09.368941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:04:09.369178 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:04:09.371241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:04:09.387854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:04:09.389805 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:04:09.401844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1277/2562] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:04:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:04:18.054016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:04:18.055587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:04:18.069961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7558-20cf-46ef-8966-2da7efee31ab service placement] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:04:18.074860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:04:18.075755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:04:18.076030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:04:18.076307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] PATH_INFO: `/v3/users/26fed87e1ecb47478db1cffa6d53f416` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:04:18.077501 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fed87e1ecb47478db1cffa6d53f416)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:04:18.079465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:04:18.128514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fed87e1ecb47478db1cffa6d53f416'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.135392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fed87e1ecb47478db1cffa6d53f416'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.136054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fed87e1ecb47478db1cffa6d53f416'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.144163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fed87e1ecb47478db1cffa6d53f416'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.155528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-3f62f44c-0e1e-43e2-8a85-ab1d4863d6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fed87e1ecb47478db1cffa6d53f416'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.161306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1286/2563] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:04:18 2021] DELETE /identity/v3/users/26fed87e1ecb47478db1cffa6d53f416 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:04:18.341863 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:04:18.357834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609caf2-3d06-4a96-b670-66a92953ef78 service nova] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:04:18.421674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:04:18.422469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:04:18.422778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:04:18.423049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] PATH_INFO: `/v3/projects/656fb5fa69a64dd49ed36532dfa2ef18` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:04:18.424215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656fb5fa69a64dd49ed36532dfa2ef18)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:04:18.426104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:04:18.476993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656fb5fa69a64dd49ed36532dfa2ef18', 'request_id': 'req-3410bac5-19c7-48fb-9809-8053c26f0119'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.485928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656fb5fa69a64dd49ed36532dfa2ef18', 'request_id': 'req-3410bac5-19c7-48fb-9809-8053c26f0119'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.491989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656fb5fa69a64dd49ed36532dfa2ef18', 'request_id': 'req-3410bac5-19c7-48fb-9809-8053c26f0119'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.503517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] The token cache is being invalidate because project 656fb5fa69a64dd49ed36532dfa2ef18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:04:18.503798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.504492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:04:18.506101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1278/2564] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:04:18 2021] DELETE /identity/v3/projects/656fb5fa69a64dd49ed36532dfa2ef18 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:05:17.935644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a243-f3d2-4b66-b096-12392413214b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:17.936887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a243-f3d2-4b66-b096-12392413214b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:17.937742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a243-f3d2-4b66-b096-12392413214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:17.958320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3884a243-f3d2-4b66-b096-12392413214b None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:05:17.960117 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3884a243-f3d2-4b66-b096-12392413214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:18.029586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1287/2565] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:05:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:05:18.079628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:05:18.081807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:18.155973 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bac5-19c7-48fb-9809-8053c26f0119 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:05:18.161752 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:05:18.162419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:18.162736 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:18.163012 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:18.171328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:05:18.172912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fa11c-ea75-4b8c-a060-7107e49e6f7b service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:05:18.183850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1279/2566] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:05:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:05:32.588318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:32.588983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:32.588983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] PATH_INFO: `/` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:32.591162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1288/2567] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 12:05:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 12:05:32.604240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d91e-fcde-4298-a164-a67698b63d5e None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:32.604812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d91e-fcde-4298-a164-a67698b63d5e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:32.604812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776d91e-fcde-4298-a164-a67698b63d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:32.623755 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8776d91e-fcde-4298-a164-a67698b63d5e None None] MFA Rules not processed for user `1a96bba0782248589ec206a1c8c9747e`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:05:32.624975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8776d91e-fcde-4298-a164-a67698b63d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:32.701506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1280/2568] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 12:05:32 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:05:32.715136 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:05:32.717632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:32.781593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc944-59f0-4030-9815-425314cc9a8c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:05:32.785809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:05:32.786827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:32.787275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:32.787741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:32.808681 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:05:32.810293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41fb52-7e24-461a-a967-d3815616dc2f service glance] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:05:32.822110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1289/2569] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:05:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:05:32.896691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:32.896938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:32.897232 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] PATH_INFO: `/` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:32.899079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1281/2570] 10.222.0.65 () {54 vars in 921 bytes} [Thu Dec 23 12:05:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 23 12:05:32.905050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3a2bd-f7c4-4b0d-a47e-760e6be28bcd None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:32.905359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3a2bd-f7c4-4b0d-a47e-760e6be28bcd None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:32.905733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3a2bd-f7c4-4b0d-a47e-760e6be28bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:32.932489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a9d3a2bd-f7c4-4b0d-a47e-760e6be28bcd None None] MFA Rules not processed for user `ec66b04133444ff889865e3943181507`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:05:32.933620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a9d3a2bd-f7c4-4b0d-a47e-760e6be28bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:32.988795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1290/2571] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Dec 23 12:05:32 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:05:33.002728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:05:33.004704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:33.019098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f2270-5727-424e-94d4-5f7901c3881a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:05:33.023460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:05:33.024099 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:33.024381 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:33.024654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:33.038074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:05:33.039720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:05:33.047432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1282/2572] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:05:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:05:36.117610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b430-26d7-41b2-9eca-6d4bb1d7d0f9 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:36.118144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b430-26d7-41b2-9eca-6d4bb1d7d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:36.118144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b430-26d7-41b2-9eca-6d4bb1d7d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:36.137001 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-77b0b430-26d7-41b2-9eca-6d4bb1d7d0f9 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:05:36.138211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-77b0b430-26d7-41b2-9eca-6d4bb1d7d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:36.147390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1291/2573] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:05:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:05:36.160280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:05:36.172712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23323393-7fe2-4b71-9551-9a1859d71162 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:05:36.178311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:05:36.178982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:36.179264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:36.179540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:36.188069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:05:36.189727 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:05:36.198487 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1283/2574] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:05:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 23 12:05:58.080359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:58.080946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:58.080946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:58.099303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:05:58.100505 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:05:58.109350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1292/2575] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:05:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:05:58.123843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:05:58.134385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a40a7-28ab-44d1-bffc-ad52929a204a service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:05:58.139992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:05:58.140654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:05:58.140951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:05:58.141215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:05:58.150276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:05:58.151910 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:05:58.160547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1284/2576] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:05:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:06:50.132964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:06:50.134451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:06:50.206293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1c652-4705-4f59-b72c-7fb5f9f9b767 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:06:50.212300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:06:50.212950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:06:50.213232 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:06:50.213504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:06:50.215596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:06:50.227658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:06:50.229172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:06:50.239399 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1293/2577] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:06:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:06:57.927090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:06:57.928671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:06:57.942237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c2f45-3f39-4d54-93b2-f0177aaf3091 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:06:57.948028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:06:57.948953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:06:57.949398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:06:57.949778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:06:57.953051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:06:58.027673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:06:58.029109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:06:58.039309 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1285/2578] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:06:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:01.695584 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:01.698661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:01.715605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e3de-d971-4cf4-8145-68da313bc83e service placement] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:01.720943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:01.721940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:01.722285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:01.722649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] PATH_INFO: `/v3/users/804530daa2704fcdb1fef91615b62c99` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:01.724016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=804530daa2704fcdb1fef91615b62c99)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:01.726114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:01.787176 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804530daa2704fcdb1fef91615b62c99'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:01.794883 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804530daa2704fcdb1fef91615b62c99'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:01.796065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804530daa2704fcdb1fef91615b62c99'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:01.803351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804530daa2704fcdb1fef91615b62c99'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:01.815072 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-892e9ab2-8d54-4f40-b11b-d9a7cc2b1a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804530daa2704fcdb1fef91615b62c99'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:01.821091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1294/2579] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:01 2021] DELETE /identity/v3/users/804530daa2704fcdb1fef91615b62c99 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:02.041004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.051492 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0459c9-a645-4944-a640-b8ed9dc5a6d8 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.130523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.131443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.131809 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.132024 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] PATH_INFO: `/v3/projects/e6c655658b5f4f53b4145ea20afcf1d4` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.134464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c655658b5f4f53b4145ea20afcf1d4)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.136480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.185463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c655658b5f4f53b4145ea20afcf1d4', 'request_id': 'req-ab52e2d9-68bb-468f-8b34-417700628457'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:02.193464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c655658b5f4f53b4145ea20afcf1d4', 'request_id': 'req-ab52e2d9-68bb-468f-8b34-417700628457'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:02.199258 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c655658b5f4f53b4145ea20afcf1d4', 'request_id': 'req-ab52e2d9-68bb-468f-8b34-417700628457'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:02.210478 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] The token cache is being invalidate because project e6c655658b5f4f53b4145ea20afcf1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:02.210783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:02.211454 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ab52e2d9-68bb-468f-8b34-417700628457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:02.213086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1286/2580] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:02 2021] DELETE /identity/v3/projects/e6c655658b5f4f53b4145ea20afcf1d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:02.219149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.219434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.219709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.238123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:02.239514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:02.301832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1295/2581] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:02.309953 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.310229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.310504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.329150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:02.330355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:02.338714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1287/2582] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:02.343002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.352867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6122-bdf3-41ae-b2b1-d239f75a3b77 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.358683 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.359366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.359649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.360349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.360876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:02.361211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.362887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.379496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1296/2583] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:07:02.381468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.391604 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1a02a-75b4-42d3-89b2-dc000b448506 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.397406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.398067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.398345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.398656 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.399361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.401326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.446538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.450595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1288/2584] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:02 2021] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:02.456622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93cb6-7688-4a4c-924d-b6ed96a64e67 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.522622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.523724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.524182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.524460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.525315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.527553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.550652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1297/2585] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:02 2021] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:02.554504 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.567547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016ef7-24f9-4a6d-8e64-5ace1676fed0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.575216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.576147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.577049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.577382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.578194 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.581043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.595144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1289/2586] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:02.596244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.607132 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d25d8-4f9c-4c94-9ed5-a12cd2d7feb2 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.612482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.613165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.613440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.613908 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.614987 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.616758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f619e-405c-407b-ac49-c67f7a49358e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.631828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1298/2587] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:02 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:02.637527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.648837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d75cb-fe86-46e1-aff4-4fe4b40206cc admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.655248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.657222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.657610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.658098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] PATH_INFO: `/v3/projects/ec5abea5f2f14162878882d16c499022/users/e1980733ecf14aa29110fa6e9840f973/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.674183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5abea5f2f14162878882d16c499022, user_id=e1980733ecf14aa29110fa6e9840f973, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.677966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.694269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1290/2588] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:02 2021] PUT /identity/v3/projects/ec5abea5f2f14162878882d16c499022/users/e1980733ecf14aa29110fa6e9840f973/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:02.704539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebb4-0498-4a24-adac-0fe3102636b3 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.705111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebb4-0498-4a24-adac-0fe3102636b3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.705218 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551ebb4-0498-4a24-adac-0fe3102636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.736977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6551ebb4-0498-4a24-adac-0fe3102636b3 None None] MFA Rules not processed for user `e1980733ecf14aa29110fa6e9840f973`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:02.738369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6551ebb4-0498-4a24-adac-0fe3102636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:02.830712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1299/2589] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:02 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:02.842175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:02.844037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:02.932904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11671-402b-47ec-bd24-5edeca129586 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:02.941860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:02.942603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:02.942852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:02.943126 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:02.955109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:02.956871 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:02.971716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1291/2590] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:02 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:05.073631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:05.074172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:05.074172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:05.094275 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] MFA Rules not processed for user `a351cbc96e894a03906076d2652272a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:05.095485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:05.151134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1300/2591] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:05 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:05.466424 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:05.467892 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:05.524683 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cf8fe-b1e5-4527-87a4-a642756d3d57 service nova] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:05.528934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:05.529565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:05.529839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:05.530106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:05.532094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:05.541872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:05.543313 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8afd-bb5b-49f6-9543-f54b3014222a service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:05.551270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1292/2592] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:05 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:05.674755 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:05.742054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62687a4-8e4c-463c-8e82-37e53ed51b03 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:05.748461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:05.749351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:05.749797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:05.749923 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] PATH_INFO: `/v3/users/e1980733ecf14aa29110fa6e9840f973` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:05.751228 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1980733ecf14aa29110fa6e9840f973)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:05.753172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:05.802536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1980733ecf14aa29110fa6e9840f973'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:05.809612 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1980733ecf14aa29110fa6e9840f973'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:05.810475 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1980733ecf14aa29110fa6e9840f973'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:05.818357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1980733ecf14aa29110fa6e9840f973'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:05.831557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1980733ecf14aa29110fa6e9840f973'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:05.837932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1301/2593] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:05 2021] DELETE /identity/v3/users/e1980733ecf14aa29110fa6e9840f973 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:05.842678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:05.843162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:05.843446 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:05.863053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:05.865097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:05.937244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1293/2594] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:05.948484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:05.949995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:06.020994 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6b2ca-962d-4a9f-ba8b-3d0fec75f1f9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.025720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.026375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.028844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.028844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.040556 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.042034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c397c-0ecb-4ed1-9bb8-c9fb61d6ab76 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.053364 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1302/2595] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:06.343917 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.345547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:06.361236 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656559-4070-4f38-8a15-5445ed5896de None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.367501 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.369189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.369470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.369741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] PATH_INFO: `/v3/projects/ec5abea5f2f14162878882d16c499022` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.371058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5abea5f2f14162878882d16c499022)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.372968 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.421389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5abea5f2f14162878882d16c499022', 'request_id': 'req-66bee046-3e14-40e3-b27c-38672d83eb0a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:06.429569 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5abea5f2f14162878882d16c499022', 'request_id': 'req-66bee046-3e14-40e3-b27c-38672d83eb0a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:06.435176 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5abea5f2f14162878882d16c499022', 'request_id': 'req-66bee046-3e14-40e3-b27c-38672d83eb0a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:06.446676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] The token cache is being invalidate because project ec5abea5f2f14162878882d16c499022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:06.446931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:06.447634 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-66bee046-3e14-40e3-b27c-38672d83eb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:06.450614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1294/2596] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:06 2021] DELETE /identity/v3/projects/ec5abea5f2f14162878882d16c499022 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:06.456453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.456964 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.457071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.478039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:06.479578 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:06.545411 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1303/2597] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:06.553749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.554253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.554352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.572815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:06.574058 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:06.585550 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1295/2598] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:06.589974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.602603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bf10-dd0b-4597-9889-2013c89131ff None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.612239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.613206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.613538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.613980 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.614872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:06.615257 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.617517 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.633384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1304/2599] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:07:06.638425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.651259 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264a1bc-2618-4ebe-8ba3-ed171ecf10fd None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.658032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.659015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.659331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.659629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.660667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.662782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.694787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1296/2600] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:06 2021] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:06.699348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.710969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670e095-2602-4c77-84dd-e2d6b4f939a1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.770388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.771092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.771370 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.771643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.772344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.774272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.795470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1305/2601] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:06 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:06.799883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.810395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2132750-81cd-46a1-97d0-541ab5092493 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.815308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.815995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.816279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.816553 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.817493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.819135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.829521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1297/2602] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:06.833992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.845092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ca166-de76-41e2-9034-0dcad88c3f58 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.851107 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.851810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.852359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.852633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.853376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.855071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367f878-13fe-491c-b160-41a4c012fd57 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.866736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1306/2603] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:06.872822 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:06.886192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d4bfa-62c1-49da-abf6-520af46b1d31 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:06.891151 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:06.892036 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.892295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.892801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] PATH_INFO: `/v3/projects/ec700affb55e4e948eb22c0412aa078c/users/a9243d50ebf2423f9c22a1488b103435/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.908310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec700affb55e4e948eb22c0412aa078c, user_id=a9243d50ebf2423f9c22a1488b103435, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:06.911003 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:06.925118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1298/2604] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:06 2021] PUT /identity/v3/projects/ec700affb55e4e948eb22c0412aa078c/users/a9243d50ebf2423f9c22a1488b103435/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:06.937138 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:06.937421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:06.937692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:06.967762 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] MFA Rules not processed for user `a9243d50ebf2423f9c22a1488b103435`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:06.969893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:07.039156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1307/2605] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:07.043789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.110211 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f706b3e-6aba-446f-af48-cde46f9f5199 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.115264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.115939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.116226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.116508 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.117235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.119370 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.148001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1299/2606] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:07 2021] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:07.152105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.162676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f5f1b-e5e8-4c00-8ee7-fd7f4a1bca8a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.219720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.220398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.220678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.220949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.221644 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.223657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.246135 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1308/2607] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:07 2021] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:07.248821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.259649 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16f7d8-96fb-401b-ba21-436f86e186f2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.264349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.265009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.265284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.265549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.266272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.267884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.278366 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1300/2608] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:07.282705 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.293141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62736a3-05e5-4b31-b626-86051e025567 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.298844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.299738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.300021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.300294 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] PATH_INFO: `/v3/projects/223f855e7bf0495aa4106cdecb37f341/users/4a8658e52fbb4a4ab41ba06aebbbee8f/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.315251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223f855e7bf0495aa4106cdecb37f341, user_id=4a8658e52fbb4a4ab41ba06aebbbee8f, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.319447 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.336141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1309/2609] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:07 2021] PUT /identity/v3/projects/223f855e7bf0495aa4106cdecb37f341/users/4a8658e52fbb4a4ab41ba06aebbbee8f/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:07.340303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.351200 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e28b4-c84d-4533-9562-7ce854ef5fd9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.410561 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.411272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.411557 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.411833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.412578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.414174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07793a-4215-4a18-95f5-5bea49701f66 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.424264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1301/2610] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:07:07.428809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.439147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd371c3-e4ff-4588-b051-5c9780d176a7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.444318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.445216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.445497 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.445769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] PATH_INFO: `/v3/projects/223f855e7bf0495aa4106cdecb37f341/users/4a8658e52fbb4a4ab41ba06aebbbee8f/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.447979 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=223f855e7bf0495aa4106cdecb37f341, user_id=4a8658e52fbb4a4ab41ba06aebbbee8f, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.450811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.461901 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1310/2611] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:07 2021] PUT /identity/v3/projects/223f855e7bf0495aa4106cdecb37f341/users/4a8658e52fbb4a4ab41ba06aebbbee8f/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:07.472134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.472464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.473049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.500541 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] MFA Rules not processed for user `4a8658e52fbb4a4ab41ba06aebbbee8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:07.501750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:07.568509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1302/2612] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:07 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:07.579222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.581101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:07.638227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b145ee-bac8-40cd-ae5d-97763271a49d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.642401 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.643125 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.643429 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.643707 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.653481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.655057 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383d0e0-c75d-4eba-8747-71e0d7de4262 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.665583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1311/2613] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:07 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:07.706625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.783340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318453-44f2-46b4-926f-8afd959bb5b1 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:07.788257 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:07.789163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.789441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.789714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] PATH_INFO: `/v3/users/a9243d50ebf2423f9c22a1488b103435` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.791025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9243d50ebf2423f9c22a1488b103435)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:07.792969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:07.850411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9243d50ebf2423f9c22a1488b103435'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:07.858135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9243d50ebf2423f9c22a1488b103435'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:07.859129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9243d50ebf2423f9c22a1488b103435'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:07.872962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9243d50ebf2423f9c22a1488b103435'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:07.873705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9243d50ebf2423f9c22a1488b103435'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:07.888404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1303/2614] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:07 2021] DELETE /identity/v3/users/a9243d50ebf2423f9c22a1488b103435 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:07.893179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:07.893471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:07.893796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:07.915469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:07.917096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:07.974231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1312/2615] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:07.993955 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:07.995844 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:08.073538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4748-beb5-42df-a6f6-8e64d5e8708d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:08.077919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:08.078735 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:08.079282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:08.079689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:08.090453 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:08.092114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:08.102345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1304/2616] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:08.397832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:08.399504 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:08.417183 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59bf62-da0d-46da-a427-693205cf1378 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:08.422607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:08.423564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:08.423846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:08.424113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] PATH_INFO: `/v3/projects/ec700affb55e4e948eb22c0412aa078c` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:08.425369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec700affb55e4e948eb22c0412aa078c)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:08.428787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:08.488995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec700affb55e4e948eb22c0412aa078c', 'request_id': 'req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.498758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec700affb55e4e948eb22c0412aa078c', 'request_id': 'req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.506719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec700affb55e4e948eb22c0412aa078c', 'request_id': 'req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.518453 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] The token cache is being invalidate because project ec700affb55e4e948eb22c0412aa078c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:08.518766 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.519402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.521014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1313/2617] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:08 2021] DELETE /identity/v3/projects/ec700affb55e4e948eb22c0412aa078c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:08.525093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:08.536044 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327219c-9116-4af1-aa03-d9410ce2b61c service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:08.633142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:08.634062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:08.634339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:08.634641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] PATH_INFO: `/v3/users/4a8658e52fbb4a4ab41ba06aebbbee8f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:08.636015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8658e52fbb4a4ab41ba06aebbbee8f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:08.637937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:08.692000 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8658e52fbb4a4ab41ba06aebbbee8f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.700113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8658e52fbb4a4ab41ba06aebbbee8f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.700901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8658e52fbb4a4ab41ba06aebbbee8f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.713028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8658e52fbb4a4ab41ba06aebbbee8f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.713877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8658e52fbb4a4ab41ba06aebbbee8f'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:08.728506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1305/2618] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:08 2021] DELETE /identity/v3/users/4a8658e52fbb4a4ab41ba06aebbbee8f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:09.011669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.013588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.014065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.015437 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.078642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e86aab-1cf1-4dfa-b75d-291a6f08eacb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.087658 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadbe05-8faa-47ad-abe4-de017d264fb2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.092441 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.093317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.093596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.094014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] PATH_INFO: `/v3/projects/223f855e7bf0495aa4106cdecb37f341` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.095340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223f855e7bf0495aa4106cdecb37f341)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.097246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.134040 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.134753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.135035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.135303 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.137045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.145134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223f855e7bf0495aa4106cdecb37f341', 'request_id': 'req-11cdb7a6-7b57-491c-bdce-4553f4288659'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:09.154388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223f855e7bf0495aa4106cdecb37f341', 'request_id': 'req-11cdb7a6-7b57-491c-bdce-4553f4288659'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:09.160800 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223f855e7bf0495aa4106cdecb37f341', 'request_id': 'req-11cdb7a6-7b57-491c-bdce-4553f4288659'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:09.172051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] The token cache is being invalidate because project 223f855e7bf0495aa4106cdecb37f341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:09.172337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:09.172983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-11cdb7a6-7b57-491c-bdce-4553f4288659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:09.174576 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1306/2619] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:09 2021] DELETE /identity/v3/projects/223f855e7bf0495aa4106cdecb37f341 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:09.180684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.180972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.181246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.198860 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.200115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:09.200381 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10999271-246f-4967-b182-80b5b8872d4e service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.201391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.212067 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1314/2620] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:09.269016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1307/2621] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:09.276645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.276933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.277209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.299296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:09.300936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.314415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1315/2622] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:09.315905 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.328243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adadadc-54d5-4b2b-9df4-82e0409e9fdb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.334393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.335872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.336303 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.336745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.337636 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:09.338091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.339872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.364591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1308/2623] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 12:07:09.369113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.378489 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c71ef-7aaf-4788-8897-86db0aad938a None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.383566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.384239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.384521 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.384794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.385653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.387627 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.424671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1316/2624] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:07:09.429186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.439033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9ebf-5e3d-4384-a961-f3e2c3223309 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.500629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.501856 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.502188 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.502465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.503226 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.505339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.529942 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1309/2625] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:07:09.534073 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.546430 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d796-d393-421e-843c-9c37dd006a70 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.552719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.553531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.553912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.554309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.555282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.557000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.571858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1317/2626] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:09 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:09.575757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.586884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe27da-9897-4606-92c7-84db034e7a02 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.591784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.592460 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.592742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.593019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.593766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.595395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12fc11-0719-4756-9392-f17c691f30d9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.610696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1310/2627] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:09.612177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.623078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484bcd2-ffac-4c56-b020-14c701f8ec9a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.627926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.629027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.630254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.630738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] PATH_INFO: `/v3/projects/43152824798a429c942c7e12ca77ac61/users/446cf4e0255e44ccbeb5dc9d2346e6e0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.649568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43152824798a429c942c7e12ca77ac61, user_id=446cf4e0255e44ccbeb5dc9d2346e6e0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.652603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.668357 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1318/2628] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:09 2021] PUT /identity/v3/projects/43152824798a429c942c7e12ca77ac61/users/446cf4e0255e44ccbeb5dc9d2346e6e0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:09.679618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.680193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.680708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.712609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] MFA Rules not processed for user `446cf4e0255e44ccbeb5dc9d2346e6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:09.714130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:09.781792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1311/2629] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:09.786589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.848915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb97c7-85cf-4790-9e2b-5e452406665d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.853616 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.854287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.854609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.854890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.855638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.857921 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.887513 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1319/2630] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:07:09.888996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:09.901137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12940079-606c-4d04-bbe6-f29229d3c7de None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:09.961603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:09.962394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:09.962707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:09.962997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:09.963724 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:09.965673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:09.987161 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1312/2631] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:09 2021] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:09.991449 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.001662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7064a-855c-4b52-9a66-f3a847a4e7c1 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.007815 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.008508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.008782 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.009111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.009850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.011841 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.023649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1320/2632] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:09 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:07:10.027681 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.038388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eb348-9b99-4484-ad97-fa6c2823efe3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.043471 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.044360 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.044641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.044915 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] PATH_INFO: `/v3/projects/84013791d8f2494fae8e4f2203b565cf/users/21a73dd77d4c42f6842f5b78b1e3984a/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.062404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84013791d8f2494fae8e4f2203b565cf, user_id=21a73dd77d4c42f6842f5b78b1e3984a, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.065105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.079214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1313/2633] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:10 2021] PUT /identity/v3/projects/84013791d8f2494fae8e4f2203b565cf/users/21a73dd77d4c42f6842f5b78b1e3984a/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:10.083850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.094887 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912071-fa8a-42a3-98df-d85573f438b8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.154448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.155153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.155438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.155709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.156472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.158095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.169920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1321/2634] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:10 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:10.174028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.182552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.184672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:10.187282 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004a5e-713a-4475-aa7d-8715b0eba608 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.195357 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.196270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.196601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.196876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] PATH_INFO: `/v3/projects/84013791d8f2494fae8e4f2203b565cf/users/21a73dd77d4c42f6842f5b78b1e3984a/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.199314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84013791d8f2494fae8e4f2203b565cf, user_id=21a73dd77d4c42f6842f5b78b1e3984a, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.204802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936942b-d3fc-4f6b-8c45-27b1afe91555 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.216874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1314/2635] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:10 2021] PUT /identity/v3/projects/84013791d8f2494fae8e4f2203b565cf/users/21a73dd77d4c42f6842f5b78b1e3984a/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:10.229117 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.229398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.229678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.299925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] MFA Rules not processed for user `21a73dd77d4c42f6842f5b78b1e3984a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:10.301574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:10.331869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447596d0-43ec-4a49-97e5-49e2d10d5b7a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.438427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1315/2636] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:10 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:10.451319 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.453540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:10.453772 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.454721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.455152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.455597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.458154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:10.487065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.489074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.517099 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1322/2637] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:10.533171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b120c9-2628-44f2-aa2a-f3bf191ee7c8 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.540229 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.543868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.544030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.544218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.561982 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.568221 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.581115 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1316/2638] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:10 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:07:10.630185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:10.631731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:10.643637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66271-654a-4539-aeb5-63b574d4dd49 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:10.647726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:10.648407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:10.649163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:10.649163 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:10.709970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:10.711477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abef5df-c6b0-4dd9-948d-7e39100dd4b1 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:10.721993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1323/2639] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:10 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:14.054007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:14.126318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60665-bf64-4910-b676-c40f55c30ebf service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:14.131362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:14.132239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:14.132522 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:14.132798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] PATH_INFO: `/v3/users/446cf4e0255e44ccbeb5dc9d2346e6e0` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:14.134075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=446cf4e0255e44ccbeb5dc9d2346e6e0)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:14.136177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:14.190049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446cf4e0255e44ccbeb5dc9d2346e6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.197477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446cf4e0255e44ccbeb5dc9d2346e6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.198163 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446cf4e0255e44ccbeb5dc9d2346e6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.211482 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446cf4e0255e44ccbeb5dc9d2346e6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.212263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446cf4e0255e44ccbeb5dc9d2346e6e0'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.226425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1317/2640] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:14 2021] DELETE /identity/v3/users/446cf4e0255e44ccbeb5dc9d2346e6e0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:14.231922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:14.232798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:14.233182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:14.257280 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:14.258481 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:14.321574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1324/2641] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:14.334218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:14.336114 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:14.400967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08921-2097-455a-a1c7-05ef1cf7cdcb admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:14.405051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:14.405692 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:14.406032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:14.406406 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:14.415920 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:14.417461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:14.426912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1318/2642] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:14.697539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:14.699404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:14.714058 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1018d-63e2-4e48-8dd0-65876c4d34f6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:14.720177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:14.721496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:14.721779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:14.722094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] PATH_INFO: `/v3/projects/43152824798a429c942c7e12ca77ac61` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:14.723758 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43152824798a429c942c7e12ca77ac61)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:14.726113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:14.774113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43152824798a429c942c7e12ca77ac61', 'request_id': 'req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.783002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43152824798a429c942c7e12ca77ac61', 'request_id': 'req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.788764 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43152824798a429c942c7e12ca77ac61', 'request_id': 'req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.800272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] The token cache is being invalidate because project 43152824798a429c942c7e12ca77ac61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:14.800634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.801284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.803134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1325/2643] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:14 2021] DELETE /identity/v3/projects/43152824798a429c942c7e12ca77ac61 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:14.807462 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:14.817596 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e32d4-cd44-482b-a955-d7b83c5e4c0d service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:14.876215 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:14.877098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:14.877376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:14.877661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] PATH_INFO: `/v3/users/21a73dd77d4c42f6842f5b78b1e3984a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:14.878888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a73dd77d4c42f6842f5b78b1e3984a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:14.880908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:14.927352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a73dd77d4c42f6842f5b78b1e3984a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.933754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a73dd77d4c42f6842f5b78b1e3984a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.934404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a73dd77d4c42f6842f5b78b1e3984a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.945520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a73dd77d4c42f6842f5b78b1e3984a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.946140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-bf8312a5-20ae-4106-a228-429f5caa916f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a73dd77d4c42f6842f5b78b1e3984a'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:14.959667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1319/2644] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:14 2021] DELETE /identity/v3/users/21a73dd77d4c42f6842f5b78b1e3984a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:15.229721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.231540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:15.247467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce864-1fce-44dc-8a3b-ae21c33d0878 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.311093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.311975 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.312258 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.312528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] PATH_INFO: `/v3/projects/84013791d8f2494fae8e4f2203b565cf` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.313729 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84013791d8f2494fae8e4f2203b565cf)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.315677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.364712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84013791d8f2494fae8e4f2203b565cf', 'request_id': 'req-16896705-42c9-4847-b5d9-b775c84a4979'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:15.373514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84013791d8f2494fae8e4f2203b565cf', 'request_id': 'req-16896705-42c9-4847-b5d9-b775c84a4979'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:15.382662 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84013791d8f2494fae8e4f2203b565cf', 'request_id': 'req-16896705-42c9-4847-b5d9-b775c84a4979'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:15.410976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] The token cache is being invalidate because project 84013791d8f2494fae8e4f2203b565cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:15.411306 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:15.415121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:15.417157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1326/2645] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:15 2021] DELETE /identity/v3/projects/84013791d8f2494fae8e4f2203b565cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:15.422954 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6fbd-b624-4179-8d1f-280a9dbd3a85 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.423430 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6fbd-b624-4179-8d1f-280a9dbd3a85 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.423532 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c6fbd-b624-4179-8d1f-280a9dbd3a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.437420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.438846 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:15.441972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e03c6fbd-b624-4179-8d1f-280a9dbd3a85 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:15.443496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e03c6fbd-b624-4179-8d1f-280a9dbd3a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:15.495659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16896705-42c9-4847-b5d9-b775c84a4979 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.499618 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.500296 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.500695 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.500961 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.502885 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:15.503014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1320/2646] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:15.512418 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.512864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.513340 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.517305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.519221 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.534722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1327/2647] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:07:15.539943 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:15.541384 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:15.551067 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1321/2648] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:15.555797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.566360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ff58f-dbc5-40e2-a281-d773ccd5ccf4 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.572761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.573440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.573721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.573998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.574786 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:15.575096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.576753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.593241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1328/2649] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 23 12:07:15.594408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.604247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffdbcf-8e04-4b4c-b18e-6b4e71622c73 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.609349 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.610071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.610289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.610599 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.611308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.613202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.646781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1322/2650] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:15 2021] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:15.651244 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.662419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c311193-05ba-44e7-82c5-4f09f3fb0452 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.722593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.723277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.723560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.723835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.724574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.726484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.754597 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1329/2651] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:15 2021] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:15.755858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.767458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e1f5-839a-4b3e-899e-f5ed96e48fe1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.772701 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.773414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.773699 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.773975 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.774765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.776416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.787712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1323/2652] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:15.791847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.803950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d9f93-6e7c-4c5f-9bf5-57622b85f668 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.809714 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.810398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.811006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.811518 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.812267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.813884 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb50ae7-fd37-4403-84f5-0dd45363f1c8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.827473 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1330/2653] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:15.830353 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:15.841284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fedeff-df08-4941-86d2-f66acdbeada2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:15.846248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:15.847177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.847457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.847759 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] PATH_INFO: `/v3/projects/4811804b7ea9464f850bc7e1147b990a/users/f2f290390d9f41a3bd2f425dc3422ae0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.870933 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4811804b7ea9464f850bc7e1147b990a, user_id=f2f290390d9f41a3bd2f425dc3422ae0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:15.875993 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:15.895816 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1324/2654] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:15 2021] PUT /identity/v3/projects/4811804b7ea9464f850bc7e1147b990a/users/f2f290390d9f41a3bd2f425dc3422ae0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:15.910989 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:15.911273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:15.911600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:15.939270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] MFA Rules not processed for user `f2f290390d9f41a3bd2f425dc3422ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:15.940797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:16.009402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1331/2655] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:15 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:16.013781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.078217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58d50-1472-4cb1-9a44-e5792b8f2d8c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.083146 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.084291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.084565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.084865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.085585 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.087583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.120109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1325/2656] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:16 2021] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:16.121498 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.133162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4e06-d996-4aaa-8a76-e4039102cf6f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.197123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.198206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.198832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.199295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.200196 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.202723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.236298 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1332/2657] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:16 2021] POST /identity/v3/users => generated 307 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:16.237661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.249275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b009b08-eab7-4168-8fdc-d5256d874895 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.257284 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.258089 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.258208 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.258500 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.259372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.261804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.274558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1326/2658] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:16.278034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.289687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519549b0-d60c-4007-92f9-e3bdf7b3092b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.296098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.296955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.297233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.297506 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] PATH_INFO: `/v3/projects/373643870ab042bbaa8a56ea324a9400/users/a8ae033398084b7b99c7afaa483a8481/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.314711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373643870ab042bbaa8a56ea324a9400, user_id=a8ae033398084b7b99c7afaa483a8481, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.317393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.331553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1333/2659] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:16 2021] PUT /identity/v3/projects/373643870ab042bbaa8a56ea324a9400/users/a8ae033398084b7b99c7afaa483a8481/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:16.335531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.346053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58e974-e4b7-4fc7-bafd-6839a979f14d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.413940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.414629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.414971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.416342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.417174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.418835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe3b8-459e-41c8-b066-b3dceef8c367 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.430876 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1327/2660] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:16 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:07:16.435274 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.446484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbd0f-86a6-45bf-b46e-e9fbc2fdc3b8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.451661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.452563 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.452826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.453087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] PATH_INFO: `/v3/projects/373643870ab042bbaa8a56ea324a9400/users/a8ae033398084b7b99c7afaa483a8481/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.455236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=373643870ab042bbaa8a56ea324a9400, user_id=a8ae033398084b7b99c7afaa483a8481, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.457918 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.469156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1334/2661] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:16 2021] PUT /identity/v3/projects/373643870ab042bbaa8a56ea324a9400/users/a8ae033398084b7b99c7afaa483a8481/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:16.479277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.479873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.480362 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.510179 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] MFA Rules not processed for user `a8ae033398084b7b99c7afaa483a8481`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:16.512074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:16.587617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1328/2662] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:16 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:16.594988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.596781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:16.658736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d9e5a-057a-4301-8037-373f66a4b04c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.662943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.663611 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.663917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.664223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.675242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.676696 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.686996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1335/2663] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:16 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:07:16.777197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:16.790364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071357-4b0e-47cb-810a-f01e5bb34eaa None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:16.794650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:16.795345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:16.795625 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:16.795894 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:16.911007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:16.912841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772044-01ea-4f5a-8676-2d60a0186bc6 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:16.925422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1329/2664] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:16 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:07:21.283743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:21.359032 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c3b4-e443-4568-a944-a514f54b698f service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:21.363847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:21.365045 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:21.365324 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:21.365596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] PATH_INFO: `/v3/users/f2f290390d9f41a3bd2f425dc3422ae0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:21.367113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f290390d9f41a3bd2f425dc3422ae0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:21.369092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:21.421342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f290390d9f41a3bd2f425dc3422ae0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:21.429349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f290390d9f41a3bd2f425dc3422ae0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:21.430147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f290390d9f41a3bd2f425dc3422ae0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:21.441092 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f290390d9f41a3bd2f425dc3422ae0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:21.462434 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f290390d9f41a3bd2f425dc3422ae0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:21.470614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1336/2665] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:21 2021] DELETE /identity/v3/users/f2f290390d9f41a3bd2f425dc3422ae0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:21.474421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:21.477223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:21.477223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:21.494396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:21.495919 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:21.577245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1330/2666] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:21.585227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:21.586978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:21.667433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dec9b-b35a-4a64-b2e3-93414816fa74 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:21.671496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:21.672390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:21.672659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:21.672930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:21.684261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:21.685950 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:21.697250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1337/2667] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:21.967995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:21.969610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:21.990249 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1b6dc-1623-4ae2-a5e7-92914df3e478 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:21.999253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:22.000190 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:22.000443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:22.000757 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] PATH_INFO: `/v3/projects/4811804b7ea9464f850bc7e1147b990a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:22.001961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4811804b7ea9464f850bc7e1147b990a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:22.004720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:22.074581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4811804b7ea9464f850bc7e1147b990a', 'request_id': 'req-8a2252cb-aebb-4978-8dff-d918e651d962'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.088606 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4811804b7ea9464f850bc7e1147b990a', 'request_id': 'req-8a2252cb-aebb-4978-8dff-d918e651d962'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.095651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4811804b7ea9464f850bc7e1147b990a', 'request_id': 'req-8a2252cb-aebb-4978-8dff-d918e651d962'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.110251 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] The token cache is being invalidate because project 4811804b7ea9464f850bc7e1147b990a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:22.111059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.113326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.114998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1331/2668] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:21 2021] DELETE /identity/v3/projects/4811804b7ea9464f850bc7e1147b990a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:22.119018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:22.129273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e3db-43bf-4409-94b3-3254c469cc0a service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:22.185543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:22.186441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:22.186751 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:22.187023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] PATH_INFO: `/v3/users/a8ae033398084b7b99c7afaa483a8481` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:22.188238 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ae033398084b7b99c7afaa483a8481)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:22.190182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:22.239326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ae033398084b7b99c7afaa483a8481'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.246216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ae033398084b7b99c7afaa483a8481'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.246917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ae033398084b7b99c7afaa483a8481'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.254164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ae033398084b7b99c7afaa483a8481'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.266698 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c4c4cb58-06cf-47e2-84a6-30dd4483cf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ae033398084b7b99c7afaa483a8481'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.276318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1338/2669] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:22 2021] DELETE /identity/v3/users/a8ae033398084b7b99c7afaa483a8481 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:22.710265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:22.713147 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:22.741470 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2252cb-aebb-4978-8dff-d918e651d962 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:22.816013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:22.821493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:22.821771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:22.822311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] PATH_INFO: `/v3/projects/373643870ab042bbaa8a56ea324a9400` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:22.824033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373643870ab042bbaa8a56ea324a9400)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:22.826137 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:22.884564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373643870ab042bbaa8a56ea324a9400', 'request_id': 'req-ce38031d-114f-430b-9864-cc869abd4887'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.898989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373643870ab042bbaa8a56ea324a9400', 'request_id': 'req-ce38031d-114f-430b-9864-cc869abd4887'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.907768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373643870ab042bbaa8a56ea324a9400', 'request_id': 'req-ce38031d-114f-430b-9864-cc869abd4887'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.920141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] The token cache is being invalidate because project 373643870ab042bbaa8a56ea324a9400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:22.920549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.921074 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:22.928655 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1332/2670] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:22 2021] DELETE /identity/v3/projects/373643870ab042bbaa8a56ea324a9400 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:22.930633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd943b-63d0-4656-bd0c-c65d55efccce None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:22.931105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd943b-63d0-4656-bd0c-c65d55efccce None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:22.931195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd943b-63d0-4656-bd0c-c65d55efccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:22.952070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-f7fd943b-63d0-4656-bd0c-c65d55efccce None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:22.953543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f7fd943b-63d0-4656-bd0c-c65d55efccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:22.994162 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:22.995709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.025814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1339/2671] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:23.034743 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.035049 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.035295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.053599 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:23.054838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.062043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38031d-114f-430b-9864-cc869abd4887 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.062647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1340/2672] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:23.066943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.067502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.068539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.068779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.069060 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] PATH_INFO: `/v3/users/3d641a1c7e09494d86fe4a3bb88a6309` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.070456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d641a1c7e09494d86fe4a3bb88a6309)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.072458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.075790 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dbcc6-19b1-4518-b617-0c140fdff441 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.080904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.081542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.081820 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.082093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.082868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:23.083175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.084858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.096585 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1341/2673] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:07:23.101137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.111121 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d600-93f4-42d3-af66-b9c56a1b19f8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.116315 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.117105 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.117388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.117653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.118404 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.120283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.126802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d641a1c7e09494d86fe4a3bb88a6309'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.133888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d641a1c7e09494d86fe4a3bb88a6309'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.134821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d641a1c7e09494d86fe4a3bb88a6309'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.147008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d641a1c7e09494d86fe4a3bb88a6309'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.147554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1342/2674] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:23 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:07:23.147691 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d641a1c7e09494d86fe4a3bb88a6309'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.151375 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.153190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.161104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1333/2675] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:22 2021] DELETE /identity/v3/users/3d641a1c7e09494d86fe4a3bb88a6309 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:23.217711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29168ca-05d1-4a1c-b456-9539a37121a5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.271948 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.272633 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.272913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.273210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.273947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.275913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.298540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1343/2676] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:23 2021] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:23.301612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.312139 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad6f1f-766e-4ce3-a3e1-65b44bc85306 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.317802 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.318565 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.318883 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.319187 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.319983 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.321742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.332673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1334/2677] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:23.336953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.339642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.341422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.356084 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f8be7-203a-41e8-a296-4c31cb5b70c8 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.358499 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ba9e-593b-4858-981f-8120c389c7f8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.364174 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.365129 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.365416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.365774 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] PATH_INFO: `/v3/projects/f78243e9c4ec4d51a07e39bec8a14073` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.365867 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.366600 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.366909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.367022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78243e9c4ec4d51a07e39bec8a14073)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.367201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.367896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.368839 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.369505 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.379906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1344/2678] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:23 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:23.384140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.393668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35089a9-0551-49bd-bb5c-2237735084b5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.399091 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.399974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.400240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.400508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] PATH_INFO: `/v3/projects/50d3ff105cb54863ad70a88885dea51f/users/d9c2eff497f842a2b3d67788af8e6ea9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.416066 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d3ff105cb54863ad70a88885dea51f, user_id=d9c2eff497f842a2b3d67788af8e6ea9, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.416276 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78243e9c4ec4d51a07e39bec8a14073', 'request_id': 'req-cb502bdb-8ec3-469b-ab70-d339b47bb756'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.418806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61700113-b2e8-45dd-b6c1-2af6cf7c9320 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.424177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78243e9c4ec4d51a07e39bec8a14073', 'request_id': 'req-cb502bdb-8ec3-469b-ab70-d339b47bb756'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.429764 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78243e9c4ec4d51a07e39bec8a14073', 'request_id': 'req-cb502bdb-8ec3-469b-ab70-d339b47bb756'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.432917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1345/2679] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:23 2021] PUT /identity/v3/projects/50d3ff105cb54863ad70a88885dea51f/users/d9c2eff497f842a2b3d67788af8e6ea9/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:23.441007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] The token cache is being invalidate because project f78243e9c4ec4d51a07e39bec8a14073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:23.441286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.442015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.443084 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.443368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.443638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.444007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1335/2680] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:23 2021] DELETE /identity/v3/projects/f78243e9c4ec4d51a07e39bec8a14073 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:23.447662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.448944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.470566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] MFA Rules not processed for user `d9c2eff497f842a2b3d67788af8e6ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:23.471665 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.509967 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502bdb-8ec3-469b-ab70-d339b47bb756 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.539991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1346/2681] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:23.547467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.548966 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:23.564086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.565097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.565376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.565646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] PATH_INFO: `/v3/users/20f0ef560bc9429881006be0d09d93ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.566891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f0ef560bc9429881006be0d09d93ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.568903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.604881 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7568b4-6c57-499a-8e1a-44d87cbf7b56 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.608897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.609549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.609827 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.610100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.613698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f0ef560bc9429881006be0d09d93ed'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.618592 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.620044 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.620926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f0ef560bc9429881006be0d09d93ed'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.621622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f0ef560bc9429881006be0d09d93ed'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.628952 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1347/2682] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:23 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:07:23.634189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f0ef560bc9429881006be0d09d93ed'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.634812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-2c442e3b-a710-4563-90a8-1ab600ba2789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f0ef560bc9429881006be0d09d93ed'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.649652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1336/2683] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:23 2021] DELETE /identity/v3/users/20f0ef560bc9429881006be0d09d93ed => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:23.830354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:23.841427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fe706-1c24-4405-9d15-3c9d50d38048 service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:23.905446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:23.906349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:23.906659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:23.906927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] PATH_INFO: `/v3/projects/99c9026446f34700b49c48ccdec95fbe` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:23.908201 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c9026446f34700b49c48ccdec95fbe)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:23.910017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:23.959877 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c9026446f34700b49c48ccdec95fbe', 'request_id': 'req-03a70ee3-24ac-4035-b99e-a3d37ec004d3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.967678 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c9026446f34700b49c48ccdec95fbe', 'request_id': 'req-03a70ee3-24ac-4035-b99e-a3d37ec004d3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.973239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c9026446f34700b49c48ccdec95fbe', 'request_id': 'req-03a70ee3-24ac-4035-b99e-a3d37ec004d3'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.985784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] The token cache is being invalidate because project 99c9026446f34700b49c48ccdec95fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:23.986102 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.986866 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-03a70ee3-24ac-4035-b99e-a3d37ec004d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:23.988647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1348/2684] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:23 2021] DELETE /identity/v3/projects/99c9026446f34700b49c48ccdec95fbe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:24.980230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:24.980761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:24.980761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:24.999121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] MFA Rules not processed for user `d9c2eff497f842a2b3d67788af8e6ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:25.000301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:25.055244 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1337/2685] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:41.450305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7b893-edd4-4085-9784-ac368d68a5bb None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:41.450858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7b893-edd4-4085-9784-ac368d68a5bb None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:41.450858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7b893-edd4-4085-9784-ac368d68a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:41.468917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-efd7b893-edd4-4085-9784-ac368d68a5bb None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:41.470087 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-efd7b893-edd4-4085-9784-ac368d68a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:41.524607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1349/2686] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:07:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:41.578331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:41.579914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:41.652855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412de0-23cb-4651-b837-cd148df4b17f None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:41.659358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:41.660015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:41.660372 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:41.660654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:41.668925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:41.670558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:41.678329 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1338/2687] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:07:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:42.201039 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8709ed-a330-482e-80af-c4679549b278 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.201389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8709ed-a330-482e-80af-c4679549b278 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.201726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8709ed-a330-482e-80af-c4679549b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.220056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-cf8709ed-a330-482e-80af-c4679549b278 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:42.221241 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-cf8709ed-a330-482e-80af-c4679549b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:42.228750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1350/2688] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:07:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:42.244741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:42.257136 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496eb40-0269-4115-9ec4-a265a1cada92 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:42.265496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:42.266143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.266419 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.266725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.275737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:42.277367 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:42.285480 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1339/2689] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:07:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:42.501606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa8d1-85f7-4453-b0d5-e9b98c8f7055 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.502118 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa8d1-85f7-4453-b0d5-e9b98c8f7055 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.502216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa8d1-85f7-4453-b0d5-e9b98c8f7055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.520435 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-c9faa8d1-85f7-4453-b0d5-e9b98c8f7055 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:42.521606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c9faa8d1-85f7-4453-b0d5-e9b98c8f7055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:42.529194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1351/2690] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:07:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:42.544448 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:42.556256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13782833-a822-42aa-90e2-b099f9bb35ae service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:42.562952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:42.563598 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.563879 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.564152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.572962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:42.574711 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:42.582677 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1340/2691] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:07:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:42.921284 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.921564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.921840 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.940374 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:42.941544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:42.950007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1352/2692] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:07:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:42.967052 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:42.983153 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbc888-1f4c-41cb-a425-e853fe64e0e3 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:42.989291 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:42.989936 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:42.990268 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:42.990686 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:42.999791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:43.001369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827fc58a-8d03-4d37-8e31-06e3e3a13b02 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:43.009583 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1341/2693] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:07:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:07:45.077946 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.079583 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.147320 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9f24-9242-4c19-81e3-b89180ba223b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:45.152307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:45.153182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.153460 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.153726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] PATH_INFO: `/v3/users/d9c2eff497f842a2b3d67788af8e6ea9` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.155011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c2eff497f842a2b3d67788af8e6ea9)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:45.156960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:45.206931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c2eff497f842a2b3d67788af8e6ea9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.213653 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c2eff497f842a2b3d67788af8e6ea9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.214335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c2eff497f842a2b3d67788af8e6ea9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.222934 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c2eff497f842a2b3d67788af8e6ea9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.236641 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c2eff497f842a2b3d67788af8e6ea9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.243234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1353/2694] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:07:45 2021] DELETE /identity/v3/users/d9c2eff497f842a2b3d67788af8e6ea9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:45.247907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.248410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.248593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.266652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:45.267854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.340050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1342/2695] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:45.350576 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.352152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.417922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d2b2-27e0-496a-96cc-028224d3a280 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:45.423070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:45.423721 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.423999 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.424270 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.433988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:45.435545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99860f8-0526-4ab4-8776-7b530cf4d2f1 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:45.445225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1354/2696] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:45.640417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.642076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.663978 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796d161-6258-4a49-aeb5-433d477a409e None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:45.670939 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:45.671744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.672022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.672295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] PATH_INFO: `/v3/projects/50d3ff105cb54863ad70a88885dea51f` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.673530 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d3ff105cb54863ad70a88885dea51f)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:45.675509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:45.721306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d3ff105cb54863ad70a88885dea51f', 'request_id': 'req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.728155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d3ff105cb54863ad70a88885dea51f', 'request_id': 'req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.733979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d3ff105cb54863ad70a88885dea51f', 'request_id': 'req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.744495 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] The token cache is being invalidate because project 50d3ff105cb54863ad70a88885dea51f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:07:45.744779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.745398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9ef40c7a-4401-4f93-9f7c-85f94fb54dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:07:45.746951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1343/2697] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:07:45 2021] DELETE /identity/v3/projects/50d3ff105cb54863ad70a88885dea51f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:07:45.753065 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.753349 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.753619 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.771596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:45.772797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.834543 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1355/2698] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:45.843214 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.843571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.843928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.864771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:45.866049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:45.879294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1344/2699] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:45.884333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.896181 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c4be8-0406-479f-99fa-74f057bc3fed None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:45.902115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:45.902847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.903120 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.903416 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.904171 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:07:45.904474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:45.906100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:45.919137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1356/2700] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:07:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:07:45.924924 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.934600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b301-1204-494d-8e55-f5d915a08720 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:45.940312 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:45.941002 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:45.941288 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:45.941564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:45.942273 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:45.944253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:45.973962 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1345/2701] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:45 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:45.978209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:45.989063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1cb9-aaac-4171-9d9e-4f00db75c54a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:46.056158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:46.057088 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.057420 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.057749 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.058733 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:46.061442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:46.088071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1357/2702] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:45 2021] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:07:46.092475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:46.103337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016de3e8-607b-4cc0-beb3-bf5c1f322ef6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:46.109629 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:46.110297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.110680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.110958 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.111704 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:46.113310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:46.125817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1346/2703] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:07:46.130094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:46.140839 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9b0a2-12a3-4f10-8219-95157a9bf8be admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:46.145894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:46.146602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.146886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.147161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.147976 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:46.149507 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43427b64-da64-4ed6-8d8a-9d3b740d3bf8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:46.160000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1358/2704] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:46.166521 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:46.177878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749281b-d6dd-4b60-bc26-96e7b6b8cbec admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:46.183507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:46.184420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.184696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.184960 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] PATH_INFO: `/v3/projects/65754771daec4e08922a4c10f20ca653/users/28fb997ba3e94ce4a7cff5d5efe7d4b2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.200317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65754771daec4e08922a4c10f20ca653, user_id=28fb997ba3e94ce4a7cff5d5efe7d4b2, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:46.203063 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:46.219678 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1347/2705] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:46 2021] PUT /identity/v3/projects/65754771daec4e08922a4c10f20ca653/users/28fb997ba3e94ce4a7cff5d5efe7d4b2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:46.225017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f5a7-d56c-45ec-ad6f-027dd526ed1f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.225300 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f5a7-d56c-45ec-ad6f-027dd526ed1f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.225572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6f5a7-d56c-45ec-ad6f-027dd526ed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.252031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-11a6f5a7-d56c-45ec-ad6f-027dd526ed1f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:46.253253 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-11a6f5a7-d56c-45ec-ad6f-027dd526ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:46.334712 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1359/2706] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:07:46.347373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:46.349580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:46.411934 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f729b6-9d2d-453b-91c4-82b11ce69a57 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:46.415870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:46.416517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:46.416796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:46.417068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:46.426543 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:46.427966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:46.437799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1348/2707] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:07:50.367801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.367801 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.368288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.399397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] MFA Rules not processed for user `28fb997ba3e94ce4a7cff5d5efe7d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:50.400719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:50.483236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1360/2708] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:50.487790 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.497680 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c892d5-10df-4dcf-b426-bf1bf1bdd64f service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.502566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.503252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.503505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.503807 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.504523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.506428 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.538870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1349/2709] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:07:50 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:50.542754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.556642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07661c8b-4643-42a8-b9a8-e257ae7b116f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.614940 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.615655 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.616051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.616329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.617042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.619004 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.641388 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1361/2710] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:07:50 2021] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:07:50.645091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.655959 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d093b-6ad9-43dc-b77e-1d1b4f326e79 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.660654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.661338 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.661618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.661885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.662720 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.664310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.675801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1350/2711] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:07:50.681565 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.692144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f37226-dc60-4150-b99f-a94931926a7e admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.696833 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.697720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.697998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.698266 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] PATH_INFO: `/v3/projects/220bc21aa090477f9caf3e52e18c1664/users/fcb78138ca084b00a88919040c3bb23c/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.714598 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] RBAC: Authorizing `identity:create_grant(project_id=220bc21aa090477f9caf3e52e18c1664, user_id=fcb78138ca084b00a88919040c3bb23c, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.717426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.733360 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1362/2712] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:50 2021] PUT /identity/v3/projects/220bc21aa090477f9caf3e52e18c1664/users/fcb78138ca084b00a88919040c3bb23c/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:50.737072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.749531 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4117d67-164d-40e8-aead-1f864e2adc5f admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.803885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.804579 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.804864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.805141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.805888 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.807544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dbe1f-15de-41ae-b931-660552f0ee37 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.817348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1351/2713] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:07:50.821747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:50.832265 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b7eef-3e3f-43cd-b9aa-4dd69664290a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:50.838185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:50.839134 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:50.839413 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:50.839718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] PATH_INFO: `/v3/projects/220bc21aa090477f9caf3e52e18c1664/users/fcb78138ca084b00a88919040c3bb23c/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:50.842204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220bc21aa090477f9caf3e52e18c1664, user_id=fcb78138ca084b00a88919040c3bb23c, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:50.844849 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:50.857664 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1363/2714] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:07:50 2021] PUT /identity/v3/projects/220bc21aa090477f9caf3e52e18c1664/users/fcb78138ca084b00a88919040c3bb23c/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:07:55.400496 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3819b2-2ff0-4df6-a30c-d27c9bed008d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:55.401540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3819b2-2ff0-4df6-a30c-d27c9bed008d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:55.401832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3819b2-2ff0-4df6-a30c-d27c9bed008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:55.430866 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0c3819b2-2ff0-4df6-a30c-d27c9bed008d None None] MFA Rules not processed for user `fcb78138ca084b00a88919040c3bb23c`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:07:55.432352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0c3819b2-2ff0-4df6-a30c-d27c9bed008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:55.500385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1352/2715] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:07:55 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:07:55.512546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:07:55.517482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:07:55.594650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69e62d-4041-4153-b550-f7dadcc2d373 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:07:55.600432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:07:55.601101 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:07:55.601376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:07:55.601647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:07:55.659677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:07:55.661302 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:07:55.670809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1364/2716] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:07:55 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:17.468605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:17.469150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:17.469150 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:17.488408 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] MFA Rules not processed for user `28fb997ba3e94ce4a7cff5d5efe7d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:17.489589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:17.500616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1353/2717] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:17 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:29.583285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:29.595354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690979d6-9fa0-4e69-a227-45c5b98b2cb3 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:29.603631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:29.604209 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:29.604488 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:29.604761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:29.608142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:29.671519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:29.673110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:29.682116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1365/2718] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:31.604643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:31.668066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c70d-6a26-4e70-a796-31a03da531a4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:31.671981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:31.673095 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:31.673603 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:31.674116 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:31.677289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:31.703778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:31.705217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:31.717348 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1354/2719] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:33.934299 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:33.944271 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6218d6-8775-4523-a0a5-fa3fa238445b service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:33.948917 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:33.949580 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:33.949861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:33.950131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:33.952363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:34.022193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:34.023596 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:34.033677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1366/2720] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:34.085544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:34.094435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f44ef-77ae-45a6-a4a9-cacd8e6628fe service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:34.098451 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:34.099138 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:34.099423 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:34.099696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:34.101464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:34.115896 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:34.117350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:34.128878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1355/2721] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:35.764992 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:35.766703 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:35.777816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611f140-5cf7-4a08-a79c-d0bd2a2f6236 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:35.782017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:35.782978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:35.783463 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:35.783958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:35.793608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:35.795323 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:35.806009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1367/2722] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:35 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:37.422361 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:37.424096 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:37.447912 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379ce4-35f9-4ae8-a001-b8311c204672 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:37.452997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:37.453880 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:37.454272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:37.454595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] PATH_INFO: `/v3/users/a351cbc96e894a03906076d2652272a3` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:37.455792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a351cbc96e894a03906076d2652272a3)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:37.457685 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:37.505159 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a351cbc96e894a03906076d2652272a3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.512197 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a351cbc96e894a03906076d2652272a3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.513280 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a351cbc96e894a03906076d2652272a3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.524837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a351cbc96e894a03906076d2652272a3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.525538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ca39e2be-5843-4c2a-b968-40be27b35de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a351cbc96e894a03906076d2652272a3'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.538672 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1356/2723] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:08:37 2021] DELETE /identity/v3/users/a351cbc96e894a03906076d2652272a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:08:37.711128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:37.732658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14552973-36a1-4663-8256-68bc995c682f service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:37.790179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:37.791093 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:37.791372 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:37.791639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] PATH_INFO: `/v3/projects/83a1e536ed4249adb353b71e8bf03cfd` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:37.792847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a1e536ed4249adb353b71e8bf03cfd)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:37.794775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:37.840089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a1e536ed4249adb353b71e8bf03cfd', 'request_id': 'req-8638a370-4aca-4335-9912-422ccd8b478d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.849362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a1e536ed4249adb353b71e8bf03cfd', 'request_id': 'req-8638a370-4aca-4335-9912-422ccd8b478d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.856316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a1e536ed4249adb353b71e8bf03cfd', 'request_id': 'req-8638a370-4aca-4335-9912-422ccd8b478d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.869700 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] The token cache is being invalidate because project 83a1e536ed4249adb353b71e8bf03cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:08:37.869993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.870791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-8638a370-4aca-4335-9912-422ccd8b478d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:08:37.876909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1368/2724] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:08:37 2021] DELETE /identity/v3/projects/83a1e536ed4249adb353b71e8bf03cfd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:08:37.879832 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:37.880199 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:37.880642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:37.900048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:37.901413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:37.970852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1357/2725] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:37.979080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:37.979368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:37.979646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:37.999919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:38.001281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:38.010347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1369/2726] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:38.014935 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.024786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f222cdf-16c1-48c7-a379-6b8b4e3cdf3a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.030189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.030913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.031225 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.031520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.032270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:08:38.032567 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.034183 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.047059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1358/2727] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:08:38.051440 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.061070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e6867-4b4e-44cc-9766-b9f3222a9dfe None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.066535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.067285 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.067636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.067982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.068767 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.070821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.100361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1370/2728] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:08:38 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:08:38.104835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.116230 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d38e69-038a-485e-a7b5-869a945fca22 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.184938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.185765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.186186 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.186461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.187210 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.189118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.223456 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1359/2729] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:08:38 2021] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 23 12:08:38.227214 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.239015 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b673501-9f34-486e-94f3-fa8071ab5fb7 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.243930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.244605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.244944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.245967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.246778 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.248995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.259983 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1371/2730] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:08:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:08:38.264643 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.276358 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7a9a1-c222-4785-b276-909a332f3b47 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.281414 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.282152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.282503 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.282873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.283698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.285527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879098-b8bb-43da-90f7-3c40a1c38600 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.299823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1360/2731] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:08:38 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:08:38.301283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.311657 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5858ff-0e6c-4222-8bdc-4379d7043f69 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.317064 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.317965 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.318239 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.318557 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] PATH_INFO: `/v3/projects/a2b2d4247c1e4c7aa7b75187a8a189f2/users/48979a77dffa4ec5a51dfab475185430/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.338649 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b2d4247c1e4c7aa7b75187a8a189f2, user_id=48979a77dffa4ec5a51dfab475185430, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.341502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.359622 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1372/2732] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:08:38 2021] PUT /identity/v3/projects/a2b2d4247c1e4c7aa7b75187a8a189f2/users/48979a77dffa4ec5a51dfab475185430/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:08:38.364431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d702-133e-4615-b5df-a4dad56bd2fb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.364897 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d702-133e-4615-b5df-a4dad56bd2fb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.365177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d702-133e-4615-b5df-a4dad56bd2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.384422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0b89d702-133e-4615-b5df-a4dad56bd2fb None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:38.385651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0b89d702-133e-4615-b5df-a4dad56bd2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:38.451405 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1361/2733] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:38.461659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:38.463394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:38.524830 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fea147-8774-47bf-9193-2792bfdcb296 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:38.528726 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:38.529402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:38.529679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:38.529949 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:38.540832 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:38.542393 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca948a-d8a5-4d2c-a65d-c212c28f01d9 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:38.552283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1373/2734] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:39.199559 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:39.199813 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:39.200109 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:39.228515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] MFA Rules not processed for user `48979a77dffa4ec5a51dfab475185430`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:39.230053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:39.295665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1362/2735] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:39.306857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:39.307394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:39.307525 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:39.325180 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] MFA Rules not processed for user `48979a77dffa4ec5a51dfab475185430`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:08:39.326446 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:39.334041 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1374/2736] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:08:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:08:39.346043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:39.354111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:39.424314 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8bee0-21b6-4fe9-871f-c337b762709c None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:39.430698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:39.431355 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:39.431628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:39.431929 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:39.440396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:39.441981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdba3ff-5f24-45f9-96a7-73127762a4b6 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:39.450639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1363/2737] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:39 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:08:42.820660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:08:42.823220 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:42.837787 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9011c-2ea7-4ad9-8165-aaccfa5a89b5 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:08:42.841462 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:08:42.842337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:08:42.842564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:08:42.842842 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:08:42.844718 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:08:42.854528 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:08:42.856079 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:08:42.864932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1375/2738] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:08:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:09:01.221420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:01.222059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:01.222059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:01.242354 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] MFA Rules not processed for user `48979a77dffa4ec5a51dfab475185430`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:09:01.243601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:01.252520 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1364/2739] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:09:01 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:09:01.847744 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:09:01.850643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:01.921031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa243a-48b5-4541-b56c-89519b23f1b7 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:09:01.927540 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:09:01.928191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:01.928469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:01.928742 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:01.930626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:01.942541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:09:01.944165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:09:01.954316 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1376/2740] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:09:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:09:04.656356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:09:04.657834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:04.675744 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7851c0-b980-44b8-acdd-2e4e9f8beb6a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:09:04.682298 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:09:04.682995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:04.683281 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:04.683554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:04.685671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:04.698203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:09:04.699750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9b746-10fe-4bb0-bee6-eb0ede96cb20 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:09:04.710371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1365/2741] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:09:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:09:10.920795 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:09:10.936747 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320f5a-febb-4096-9e31-dbddc95fd268 service placement] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:09:10.943701 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:09:10.944495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:10.944852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:10.945202 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:10.947402 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:10.962111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:09:10.963415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:09:10.976353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1377/2742] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:09:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:09:16.409294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54808c-ae13-4321-b291-e9d7fe9484a0 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:16.409826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54808c-ae13-4321-b291-e9d7fe9484a0 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:16.409826 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54808c-ae13-4321-b291-e9d7fe9484a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:16.428475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-bf54808c-ae13-4321-b291-e9d7fe9484a0 None None] MFA Rules not processed for user `48979a77dffa4ec5a51dfab475185430`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:09:16.429652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-bf54808c-ae13-4321-b291-e9d7fe9484a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:16.436911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1366/2743] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:09:16 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:09:16.708958 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:09:16.721392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f8d85-629e-4621-a2bf-e5999d972418 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:09:16.726396 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:09:16.727061 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:16.727334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:16.727603 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:16.729773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:16.740606 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:09:16.742038 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:09:16.750212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1378/2744] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:09:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:09:41.895220 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:09:41.895798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:09:41.895798 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:09:41.914107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] MFA Rules not processed for user `48979a77dffa4ec5a51dfab475185430`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:09:41.915334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:09:41.923243 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1367/2745] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:09:41 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:10:27.523890 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:27.536191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc89aa-faef-4cea-888b-257e2c3481d8 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:27.541223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:27.542095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:27.542337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:27.542864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] PATH_INFO: `/v3/users/48979a77dffa4ec5a51dfab475185430` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:27.544109 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48979a77dffa4ec5a51dfab475185430)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:27.546018 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:27.592719 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48979a77dffa4ec5a51dfab475185430'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.599313 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48979a77dffa4ec5a51dfab475185430'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.600020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48979a77dffa4ec5a51dfab475185430'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.609347 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48979a77dffa4ec5a51dfab475185430'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.621680 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-cafcbda2-bbef-4af8-b5af-f3f21ab4094c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48979a77dffa4ec5a51dfab475185430'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.627558 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1379/2746] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:10:27 2021] DELETE /identity/v3/users/48979a77dffa4ec5a51dfab475185430 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:10:27.812885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:27.824144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217d3b5-ca59-47d6-9f27-8f03d63f023b None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:27.882042 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:27.882952 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:27.883239 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:27.883514 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] PATH_INFO: `/v3/projects/a2b2d4247c1e4c7aa7b75187a8a189f2` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:27.884763 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b2d4247c1e4c7aa7b75187a8a189f2)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:27.886693 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:27.933434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'request_id': 'req-9f02c095-e40c-4631-b5ee-ba2654eb9148'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.942253 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'request_id': 'req-9f02c095-e40c-4631-b5ee-ba2654eb9148'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.948787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b2d4247c1e4c7aa7b75187a8a189f2', 'request_id': 'req-9f02c095-e40c-4631-b5ee-ba2654eb9148'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.959986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] The token cache is being invalidate because project a2b2d4247c1e4c7aa7b75187a8a189f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:10:27.960311 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.961018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-9f02c095-e40c-4631-b5ee-ba2654eb9148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:10:27.962831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1368/2747] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:10:27 2021] DELETE /identity/v3/projects/a2b2d4247c1e4c7aa7b75187a8a189f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:10:27.968895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:27.969262 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:27.969569 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:27.988991 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:10:27.990137 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:28.071234 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1380/2748] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:10:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:10:28.083443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.083740 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.084038 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.104682 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:10:28.106590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:28.119781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1369/2749] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:10:28.124158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.134926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647e0c-fc6b-40c7-9020-12248e6c38c6 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.140470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.141140 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.141422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.141691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.142436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:10:28.142828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.144436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.157634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1381/2750] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:10:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:10:28.162776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.177609 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793055c5-8114-4a66-a617-4fd46f2f51ad None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.183914 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.184571 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.184851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.185131 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.185834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.187773 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.217865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1370/2751] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:10:28.222055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.232963 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22596a1-3b98-41e3-bc2d-228a6f918103 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.297632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.298345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.298624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.298936 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.299638 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.301658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.328415 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1382/2752] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:10:28.333295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.344584 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee552-53db-48eb-9265-2921f2137de0 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.350986 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.352113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.352391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.352660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.353407 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.355051 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.366882 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1371/2753] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:10:28.371380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.382397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f9ff-3bed-47bc-bbb8-63730fd2b138 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.387765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.388426 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.388711 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.388984 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.389724 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.391394 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe5400-22e2-4303-8517-120982841c5f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.401645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1383/2754] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:10:28.405708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.416064 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9d0a5-aeb9-41c2-8d48-80fd45c46f6b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.421510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.422402 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.422716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.422995 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] PATH_INFO: `/v3/projects/bc9f064f15ae497695b2df6ef3b52a0f/users/14aa5ae26bf34ea4a24af4472c565bf2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.437527 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f064f15ae497695b2df6ef3b52a0f, user_id=14aa5ae26bf34ea4a24af4472c565bf2, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.440205 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.456564 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1372/2755] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:10:28 2021] PUT /identity/v3/projects/bc9f064f15ae497695b2df6ef3b52a0f/users/14aa5ae26bf34ea4a24af4472c565bf2/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:10:28.475029 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.475490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.475771 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.503094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] MFA Rules not processed for user `14aa5ae26bf34ea4a24af4472c565bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:10:28.504295 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:28.572448 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1384/2756] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:10:28.576991 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.649461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1497469-4ccc-4a44-a48c-74d80b07b3d1 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.654895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.655578 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.655868 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.656134 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.656843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.658768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.686209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1373/2757] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:10:28.690406 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.701177 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f09af-414f-4794-af05-dbc2c2f24693 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.769100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.769765 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.770043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.770310 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.771042 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.773438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.794826 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1385/2758] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:10:28 2021] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:10:28.799015 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.809818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ca31-bddc-40e7-b048-9116b8562d80 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.814817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.815505 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.815785 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.816059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.816803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.818398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.828343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1374/2759] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:10:28.832366 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.842844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b66265-9e23-40ac-b816-e3033cb3220c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.848195 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.849074 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.849354 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.849625 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] PATH_INFO: `/v3/projects/5d8d854131764201a4cac6a88872b6d3/users/d4786b1f17e649f3ac9f7b2cf1e4e572/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.865419 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8d854131764201a4cac6a88872b6d3, user_id=d4786b1f17e649f3ac9f7b2cf1e4e572, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.868477 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.882384 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1386/2760] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:10:28 2021] PUT /identity/v3/projects/5d8d854131764201a4cac6a88872b6d3/users/d4786b1f17e649f3ac9f7b2cf1e4e572/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:10:28.886457 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.896590 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30486abb-4fe4-4703-8356-f2bb803b1f62 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.957356 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.958049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.958351 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.958646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:28.959391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:28.961072 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909ba2-575d-462e-a8fa-79cc7460376e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:28.971206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1375/2761] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:10:28 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:10:28.975632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:28.988190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a83d-bd9c-4847-9f59-93c7a812fd47 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:28.995988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:28.997334 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:28.997677 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:28.998052 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] PATH_INFO: `/v3/projects/5d8d854131764201a4cac6a88872b6d3/users/d4786b1f17e649f3ac9f7b2cf1e4e572/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:29.001503 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8d854131764201a4cac6a88872b6d3, user_id=d4786b1f17e649f3ac9f7b2cf1e4e572, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:29.005607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:29.022333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1387/2762] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:10:28 2021] PUT /identity/v3/projects/5d8d854131764201a4cac6a88872b6d3/users/d4786b1f17e649f3ac9f7b2cf1e4e572/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:10:29.032696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:29.032990 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:29.033271 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:29.060279 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] MFA Rules not processed for user `d4786b1f17e649f3ac9f7b2cf1e4e572`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:10:29.061483 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:29.134143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1376/2763] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:10:29 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:10:29.145055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:29.148056 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:29.221708 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f73d-9b70-4777-8f47-3f22ce8f5f7d admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:29.226123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:29.226809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:29.227103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:29.227376 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:29.283161 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:29.284642 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d64dd-deb3-427f-bf1b-3a389c8ab0cd service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:29.293731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1388/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:10:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:10:34.969951 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:10:34.971623 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:34.984326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30e6af-8546-4195-8774-1a904eebaf05 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:10:34.988320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:10:34.988956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:34.989237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:34.989510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:34.999082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:10:35.000513 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:10:35.010294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1377/2765] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:10:34 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:10:56.831914 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d056-cfbb-4ea2-a1da-3fdc457b010d None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:10:56.832482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d056-cfbb-4ea2-a1da-3fdc457b010d None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:10:56.832482 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33d056-cfbb-4ea2-a1da-3fdc457b010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:10:56.851542 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7e33d056-cfbb-4ea2-a1da-3fdc457b010d None None] MFA Rules not processed for user `28fb997ba3e94ce4a7cff5d5efe7d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:10:56.852754 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7e33d056-cfbb-4ea2-a1da-3fdc457b010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:10:56.919932 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1389/2766] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:10:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:00.926410 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:00.992946 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d8ff8-9051-4780-8e70-4e357b2dd40a service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:00.997901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:00.998877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:00.999392 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:00.999676 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] PATH_INFO: `/v3/users/14aa5ae26bf34ea4a24af4472c565bf2` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:01.000956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14aa5ae26bf34ea4a24af4472c565bf2)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:01.002926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:01.051264 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14aa5ae26bf34ea4a24af4472c565bf2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.058385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14aa5ae26bf34ea4a24af4472c565bf2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.059201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14aa5ae26bf34ea4a24af4472c565bf2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.071079 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14aa5ae26bf34ea4a24af4472c565bf2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.071778 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14aa5ae26bf34ea4a24af4472c565bf2'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.085679 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1378/2767] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:00 2021] DELETE /identity/v3/users/14aa5ae26bf34ea4a24af4472c565bf2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:01.091081 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:01.091582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:01.091798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:01.113855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:01.115281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:01.175574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1390/2768] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:11:01.188753 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:01.190386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:01.249006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146bd86-aac8-4abe-a173-0f36fab0c323 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:01.252799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:01.253458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:01.253739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:01.254062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:01.264450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:01.266066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:01.275766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1379/2769] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:01.544211 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:01.545797 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:01.559407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65900be-3103-44d5-8a02-3e6a9e3d64e4 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:01.565215 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:01.566363 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:01.566781 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:01.567722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] PATH_INFO: `/v3/projects/bc9f064f15ae497695b2df6ef3b52a0f` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:01.569204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9f064f15ae497695b2df6ef3b52a0f)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:01.571157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:01.620027 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9f064f15ae497695b2df6ef3b52a0f', 'request_id': 'req-add5a6ce-87f7-4fdd-a151-3e530a149e74'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.628548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9f064f15ae497695b2df6ef3b52a0f', 'request_id': 'req-add5a6ce-87f7-4fdd-a151-3e530a149e74'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.634028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9f064f15ae497695b2df6ef3b52a0f', 'request_id': 'req-add5a6ce-87f7-4fdd-a151-3e530a149e74'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.645046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] The token cache is being invalidate because project bc9f064f15ae497695b2df6ef3b52a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:01.645333 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.645974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.647588 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1391/2770] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:01 2021] DELETE /identity/v3/projects/bc9f064f15ae497695b2df6ef3b52a0f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:01.651710 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:01.661411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb2fd8-3aa7-4b7d-aee3-94668987b352 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:01.722852 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:01.724043 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:01.724323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:01.724588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] PATH_INFO: `/v3/users/d4786b1f17e649f3ac9f7b2cf1e4e572` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:01.725828 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4786b1f17e649f3ac9f7b2cf1e4e572)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:01.727941 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:01.775600 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4786b1f17e649f3ac9f7b2cf1e4e572'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.783413 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4786b1f17e649f3ac9f7b2cf1e4e572'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.784141 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4786b1f17e649f3ac9f7b2cf1e4e572'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.797589 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4786b1f17e649f3ac9f7b2cf1e4e572'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.798328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf596da-0f8f-4d86-94c9-548349dc5c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4786b1f17e649f3ac9f7b2cf1e4e572'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:01.812937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1380/2771] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:01 2021] DELETE /identity/v3/users/d4786b1f17e649f3ac9f7b2cf1e4e572 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:02.087643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.089243 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:02.105437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a6ce-87f7-4fdd-a151-3e530a149e74 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.164813 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.165674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.165953 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.166222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] PATH_INFO: `/v3/projects/5d8d854131764201a4cac6a88872b6d3` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.167484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8d854131764201a4cac6a88872b6d3)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.169387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.216734 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8d854131764201a4cac6a88872b6d3', 'request_id': 'req-18ff349b-a5a6-48f1-9c73-89a8a41456cf'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:02.225309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8d854131764201a4cac6a88872b6d3', 'request_id': 'req-18ff349b-a5a6-48f1-9c73-89a8a41456cf'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:02.234535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8d854131764201a4cac6a88872b6d3', 'request_id': 'req-18ff349b-a5a6-48f1-9c73-89a8a41456cf'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:02.246686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] The token cache is being invalidate because project 5d8d854131764201a4cac6a88872b6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:02.246967 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:02.247656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-18ff349b-a5a6-48f1-9c73-89a8a41456cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:02.249318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1392/2772] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:02 2021] DELETE /identity/v3/projects/5d8d854131764201a4cac6a88872b6d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:02.255784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.256267 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.256373 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.275198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:02.276387 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:02.337784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1381/2773] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:02.347030 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137864e-c348-44e8-ad84-7a089233248c None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.347307 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137864e-c348-44e8-ad84-7a089233248c None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.347574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137864e-c348-44e8-ad84-7a089233248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.368250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7137864e-c348-44e8-ad84-7a089233248c None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:02.369438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7137864e-c348-44e8-ad84-7a089233248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:02.377593 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1393/2774] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:02.382020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.391717 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdad91-09a0-45e1-a192-47cd94388762 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.396850 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.397511 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.397792 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.398030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.398845 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:11:02.399149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.400776 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.413094 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1382/2775] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:11:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:11:02.417527 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137864e-c348-44e8-ad84-7a089233248c None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.426993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137864e-c348-44e8-ad84-7a089233248c None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.432200 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.432929 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.433213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.433484 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.434193 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.436889 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.462970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1394/2776] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:02.467164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.477376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7fb1-7da7-47e1-872f-a41e57b4a639 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.539135 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.539703 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.539992 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.540266 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.540972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.542904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.564708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1383/2777] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:02.569007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.579512 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ddbd3-1736-4515-97e9-c7d43e951c27 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.584400 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.585055 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.585332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.585602 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.586337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.587993 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.599886 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1395/2778] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:02.603891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.615209 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd48ac-cd2d-4c02-aa58-014a3cb142fd admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.620867 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.621554 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.621829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.622093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.622875 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.624728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81434c1b-c474-4016-b89c-b09f3b68589b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.635073 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1384/2779] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:02.639674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.649676 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af669e-8845-4203-aad5-d767de8eb368 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.655531 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.656409 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.656679 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.656971 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] PATH_INFO: `/v3/projects/d668b48e7ed54761b9c73497e52d7312/users/712cb35334704590ba4c1221ae8550f0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.672560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d668b48e7ed54761b9c73497e52d7312, user_id=712cb35334704590ba4c1221ae8550f0, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.675336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.690545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1396/2780] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:02 2021] PUT /identity/v3/projects/d668b48e7ed54761b9c73497e52d7312/users/712cb35334704590ba4c1221ae8550f0/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:11:02.701708 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.701998 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.702277 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.729164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] MFA Rules not processed for user `712cb35334704590ba4c1221ae8550f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:02.730394 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:02.796865 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1385/2781] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:02.801568 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.866098 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639105-f438-4e7c-8603-8fb438efa742 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.871281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.871938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.872231 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.872490 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.873182 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.875254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:02.902895 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1397/2782] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:02.907981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:02.923296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726a00-43eb-4a64-ba91-c09f1d50b2b4 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:02.984411 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:02.985086 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:02.985369 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:02.985639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:02.986339 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:02.988322 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.011560 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1386/2783] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:02 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:03.016123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.026912 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c567f-0c60-4ce4-8da3-4df01215b063 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.032060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.032717 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.032996 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.033268 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.034005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.035613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.046146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1398/2784] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:03.050858 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.064768 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1d1bc-f50a-4797-bdd2-baa4bbcbf07b admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.070974 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.071631 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.071913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.072189 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.072927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.074547 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434ddb3-f864-4cad-bcb9-080ee4612a7e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.084667 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1387/2785] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:11:03.088920 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.099978 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b6b-d7c1-4f67-a638-9a0cfd5b030a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.106474 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.107788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.108062 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.108329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] PATH_INFO: `/v3/projects/69a794b035e84076afcfe441228574c1/users/4ba85eb9f93941098b410bc4e3a310d1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.128421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a794b035e84076afcfe441228574c1, user_id=4ba85eb9f93941098b410bc4e3a310d1, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.131162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.145956 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1399/2786] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:03 2021] PUT /identity/v3/projects/69a794b035e84076afcfe441228574c1/users/4ba85eb9f93941098b410bc4e3a310d1/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:11:03.156510 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.156812 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.157090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.184789 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] MFA Rules not processed for user `4ba85eb9f93941098b410bc4e3a310d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:03.186105 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:03.266831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1388/2787] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:03 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:03.272007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.344383 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59cac-a026-4e7e-95a4-bdccaf43c37a admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.350614 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.351560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.351844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.352111 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.353051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.355250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.390276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1400/2788] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:03 2021] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:03.396613 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.410639 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f895787-5ffa-4344-a890-9cd3f02b3de6 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.465432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.466107 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.466393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.466697 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.467642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.469823 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.493546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1389/2789] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:03 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:03.495026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.505325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbf59-da8d-446a-b72b-c2d5df9df5d9 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.510541 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.511343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.511631 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.511911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.512660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.514607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.526076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1401/2790] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:03.530605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.541097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b900-2ecd-4d54-9e74-62a7c0d8ac61 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.547343 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.548241 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.548523 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.548801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] PATH_INFO: `/v3/projects/247dc6347ee844feb2ca6325e466e3c2/users/c982382d39c1403c8a10608c701c8dc9/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.565650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247dc6347ee844feb2ca6325e466e3c2, user_id=c982382d39c1403c8a10608c701c8dc9, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.568315 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.582275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1390/2791] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:03 2021] PUT /identity/v3/projects/247dc6347ee844feb2ca6325e466e3c2/users/c982382d39c1403c8a10608c701c8dc9/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:03.586857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.597668 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffeaa1-a92b-4246-9994-a979e79c6293 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.663798 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.664687 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.665023 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.665346 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.666261 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.667970 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f689a1-fbda-4839-bc4a-647b1443de2c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.678800 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1402/2792] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:11:03.683164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.694066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2408-397b-434a-a34c-89bfda67ebd3 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.699538 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.700422 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.700712 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.700981 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] PATH_INFO: `/v3/projects/247dc6347ee844feb2ca6325e466e3c2/users/c982382d39c1403c8a10608c701c8dc9/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.703302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247dc6347ee844feb2ca6325e466e3c2, user_id=c982382d39c1403c8a10608c701c8dc9, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.705940 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.717059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1391/2793] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:03 2021] PUT /identity/v3/projects/247dc6347ee844feb2ca6325e466e3c2/users/c982382d39c1403c8a10608c701c8dc9/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:03.728353 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.728632 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.728897 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.757308 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] MFA Rules not processed for user `c982382d39c1403c8a10608c701c8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:03.758535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:03.830159 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1403/2794] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:03 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:03.840421 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:03.842548 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:03.903801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ab70d-8b7d-441a-a7ed-e66dd30cf997 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:03.908577 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:03.909223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:03.909534 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:03.909808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:03.919439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:03.921020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:03.930465 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1392/2795] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:03 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:04.418144 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:04.419723 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:04.432494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a2d0-236c-4af8-83b4-c5c967841766 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:04.436931 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:04.437574 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:04.437850 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:04.438115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:04.498146 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:04.499691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:04.509233 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1404/2796] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:04 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:08.570195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:08.579927 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11abac-9bbd-4d85-bcd9-7d5d7e743410 service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:08.584140 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:08.584783 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:08.585061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:08.585334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:08.649326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:08.650803 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e650bd-e926-4a95-a483-431246aed565 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:08.659745 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1393/2797] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:08 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:10.751115 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:10.834702 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76468fa-4375-4a1c-a755-63e7d7f8ac6b service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:10.839667 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:10.840544 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:10.840821 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:10.841089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] PATH_INFO: `/v3/users/712cb35334704590ba4c1221ae8550f0` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:10.842538 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=712cb35334704590ba4c1221ae8550f0)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:10.844508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:10.909224 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712cb35334704590ba4c1221ae8550f0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:10.916104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712cb35334704590ba4c1221ae8550f0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:10.916913 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712cb35334704590ba4c1221ae8550f0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:10.926080 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712cb35334704590ba4c1221ae8550f0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:10.938351 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712cb35334704590ba4c1221ae8550f0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:10.944184 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1405/2798] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:10 2021] DELETE /identity/v3/users/712cb35334704590ba4c1221ae8550f0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:10.948925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:10.949429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:10.949429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:10.976713 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:10.977903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:11.036307 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1394/2799] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:11.048021 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:11.049604 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:11.132738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b249c-3847-4c55-8a2e-4f89d045b34b admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:11.139397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:11.140104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:11.140380 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:11.140652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:11.151282 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:11.152731 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:11.162844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1406/2800] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:11.440761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:11.442240 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:11.475336 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61cc3a-0d6c-4dca-bc24-8cb70c02d117 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:11.480831 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:11.481716 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:11.481971 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:11.482612 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] PATH_INFO: `/v3/projects/d668b48e7ed54761b9c73497e52d7312` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:11.483874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d668b48e7ed54761b9c73497e52d7312)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:11.485782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:11.534516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd668b48e7ed54761b9c73497e52d7312', 'request_id': 'req-06c98565-7e78-473f-a9fe-fca1abc036c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.543838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd668b48e7ed54761b9c73497e52d7312', 'request_id': 'req-06c98565-7e78-473f-a9fe-fca1abc036c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.549287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd668b48e7ed54761b9c73497e52d7312', 'request_id': 'req-06c98565-7e78-473f-a9fe-fca1abc036c6'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.559779 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] The token cache is being invalidate because project d668b48e7ed54761b9c73497e52d7312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:11.560057 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.560765 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.562490 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1395/2801] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:11 2021] DELETE /identity/v3/projects/d668b48e7ed54761b9c73497e52d7312 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:11.566753 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:11.587154 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a0cc8-d58e-4161-a09b-91ef8ad85c61 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:11.658451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:11.659386 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:11.659736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:11.660014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] PATH_INFO: `/v3/users/4ba85eb9f93941098b410bc4e3a310d1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:11.661358 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba85eb9f93941098b410bc4e3a310d1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:11.663378 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:11.724650 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba85eb9f93941098b410bc4e3a310d1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.734033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba85eb9f93941098b410bc4e3a310d1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.734816 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba85eb9f93941098b410bc4e3a310d1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.744341 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba85eb9f93941098b410bc4e3a310d1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.757624 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba85eb9f93941098b410bc4e3a310d1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:11.764035 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1407/2802] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:11 2021] DELETE /identity/v3/users/4ba85eb9f93941098b410bc4e3a310d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:12.048908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:12.050539 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:12.090775 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c98565-7e78-473f-a9fe-fca1abc036c6 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:12.155793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:12.156661 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:12.156966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:12.157237 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] PATH_INFO: `/v3/projects/69a794b035e84076afcfe441228574c1` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:12.158416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a794b035e84076afcfe441228574c1)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:12.160326 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:12.205238 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a794b035e84076afcfe441228574c1', 'request_id': 'req-e1bd5a83-acfc-4029-ba8e-f74383028e90'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.214835 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a794b035e84076afcfe441228574c1', 'request_id': 'req-e1bd5a83-acfc-4029-ba8e-f74383028e90'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.221509 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a794b035e84076afcfe441228574c1', 'request_id': 'req-e1bd5a83-acfc-4029-ba8e-f74383028e90'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.232913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] The token cache is being invalidate because project 69a794b035e84076afcfe441228574c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:12.233192 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.234001 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.235650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1396/2803] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:12 2021] DELETE /identity/v3/projects/69a794b035e84076afcfe441228574c1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:12.239788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:12.241250 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:12.254309 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ce877-36ab-4401-a3fd-4c0593ae9ed5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:12.313078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:12.313893 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:12.314172 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:12.314461 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] PATH_INFO: `/v3/users/c982382d39c1403c8a10608c701c8dc9` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:12.315735 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c982382d39c1403c8a10608c701c8dc9)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:12.317672 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:12.368336 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c982382d39c1403c8a10608c701c8dc9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.375607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c982382d39c1403c8a10608c701c8dc9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.376319 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c982382d39c1403c8a10608c701c8dc9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.384922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c982382d39c1403c8a10608c701c8dc9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.397919 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-70b4da9c-9a65-416c-831c-e665c29043a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c982382d39c1403c8a10608c701c8dc9'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.403670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1408/2804] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:12 2021] DELETE /identity/v3/users/c982382d39c1403c8a10608c701c8dc9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:12.756614 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:12.758786 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:12.773121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5a83-acfc-4029-ba8e-f74383028e90 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:12.833097 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:12.833895 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:12.834177 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:12.834450 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] PATH_INFO: `/v3/projects/247dc6347ee844feb2ca6325e466e3c2` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:12.835728 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247dc6347ee844feb2ca6325e466e3c2)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:12.837651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:12.885014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247dc6347ee844feb2ca6325e466e3c2', 'request_id': 'req-ce6432d2-286c-4423-ba84-6023d4137348'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.894171 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247dc6347ee844feb2ca6325e466e3c2', 'request_id': 'req-ce6432d2-286c-4423-ba84-6023d4137348'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.899491 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247dc6347ee844feb2ca6325e466e3c2', 'request_id': 'req-ce6432d2-286c-4423-ba84-6023d4137348'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.910306 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] The token cache is being invalidate because project 247dc6347ee844feb2ca6325e466e3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:12.910622 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.911246 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-ce6432d2-286c-4423-ba84-6023d4137348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:12.912815 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1397/2805] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:12 2021] DELETE /identity/v3/projects/247dc6347ee844feb2ca6325e466e3c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:11:12.919761 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:12.920254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:12.920514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:12.949361 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:12.950671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:13.017450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1409/2806] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:13.025864 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.026234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.026601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.045836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:13.047222 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:13.056265 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1398/2807] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:13.060973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.070933 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f47ab-aaca-48fa-a83c-a94944579c0f None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.075722 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.076508 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.076684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.076959 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.077745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:11:13.078031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.079671 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.091779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1410/2808] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:11:13.095977 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.104987 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca4c21-19a4-4e3b-b6d3-dc0e643af76d None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.110328 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.111016 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.111297 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.111574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.112295 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.114202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.143320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1399/2809] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:13.147545 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.158103 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728eaf-d342-458c-8352-77de8ab12b5f admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.216433 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.217123 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.217389 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.217684 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.218387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.220356 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.242960 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1411/2810] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:13.247193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.257870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd17cb-1c2a-4edb-97ff-7fceaf86e9b7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.264122 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.264829 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.265104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.265363 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.266104 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.267737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.278690 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1400/2811] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:13.282814 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.293500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a850f5-7de4-42c1-abe8-b6bc5173b42c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.298872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.299539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.299825 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.300108 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.300852 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.302467 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d8b22-c2a9-40f8-b2f4-b359410e81a0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.312634 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1412/2812] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:11:13.317028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.327320 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25a269-07da-4e61-930c-57b67d634e0d admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.331964 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.332838 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.333118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.333389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] PATH_INFO: `/v3/projects/5e4d9f5aa2b4470c8280bf3a4ee41b0e/users/e49137b9b6ae4caf91757ac5a27a074d/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.348152 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4d9f5aa2b4470c8280bf3a4ee41b0e, user_id=e49137b9b6ae4caf91757ac5a27a074d, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.350853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.365546 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1401/2813] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:13 2021] PUT /identity/v3/projects/5e4d9f5aa2b4470c8280bf3a4ee41b0e/users/e49137b9b6ae4caf91757ac5a27a074d/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:11:13.377187 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.377551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.377904 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.404938 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] MFA Rules not processed for user `e49137b9b6ae4caf91757ac5a27a074d`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:13.406126 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:13.469392 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1413/2814] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:13.474725 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.542388 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498ce8-5916-4df8-b739-f7962000611a admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.548853 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.549516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.549796 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.550070 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.550842 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.552741 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.582066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1402/2815] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:13.586487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.597926 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37186b-198d-4d1d-826c-56483586f629 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.655595 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.656153 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.656452 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.656715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.657425 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.659551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.682855 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1414/2816] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/users => generated 311 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:13.688006 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.699286 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06767ace-b7dd-4122-bab7-7dc7201c1a19 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.704997 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.705665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.705945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.706216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.706989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.708591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.719833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1403/2817] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:11:13.725784 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.741856 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b302e-f7f5-40ef-8b27-d6840fe0d273 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.749009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.749896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.750179 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.750458 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] PATH_INFO: `/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b/users/db5edd3bb9d842658bfdaf38475bfcf1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.766709 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef712f9639c54e5cb6de3f4336e38b8b, user_id=db5edd3bb9d842658bfdaf38475bfcf1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.769390 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.784493 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1415/2818] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:13 2021] PUT /identity/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b/users/db5edd3bb9d842658bfdaf38475bfcf1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:11:13.788700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.799025 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc12647-698f-4681-b540-d019bf2427ef admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.855908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.858252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.858595 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.858848 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.859594 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.861198 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36b873-bd9d-49b0-8713-561b7ef4ad02 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.871142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1404/2819] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:13.875591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:13.886343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42c019-7e8e-4336-ac92-b4ac7e641970 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:13.892293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:13.893188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.893465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.893720 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] PATH_INFO: `/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b/users/db5edd3bb9d842658bfdaf38475bfcf1/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.895848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef712f9639c54e5cb6de3f4336e38b8b, user_id=db5edd3bb9d842658bfdaf38475bfcf1, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:13.898539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:13.910335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1416/2820] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:13 2021] PUT /identity/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b/users/db5edd3bb9d842658bfdaf38475bfcf1/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:13.921840 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:13.922202 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:13.922472 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:13.950563 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] MFA Rules not processed for user `db5edd3bb9d842658bfdaf38475bfcf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:13.952461 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:14.035165 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1405/2821] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:13 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:14.045803 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:14.047536 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:14.106273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fd77-3398-4ba3-8955-bed0ec28bf29 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:14.111106 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:14.111741 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:14.112017 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:14.112281 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:14.124553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:14.126930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:14.140034 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1417/2822] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:14 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:14.290382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:14.300296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336bef1-3f9f-4472-be58-40c6e8c1afcb None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:14.304404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:14.305130 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:14.305459 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:14.305799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:14.368937 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:14.370404 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90324d61-75d4-4afb-9c09-ce211690f3e7 service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:14.380248 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1406/2823] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:14 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:22.773988 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:22.841166 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b15570-fbb6-45c0-98c2-9cebe8beb60d service cinder] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:22.847496 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:22.848236 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:22.848519 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:22.848783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] PATH_INFO: `/v3/users/e49137b9b6ae4caf91757ac5a27a074d` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:22.850141 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49137b9b6ae4caf91757ac5a27a074d)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:22.852251 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:22.900879 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49137b9b6ae4caf91757ac5a27a074d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:22.908157 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49137b9b6ae4caf91757ac5a27a074d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:22.908943 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49137b9b6ae4caf91757ac5a27a074d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:22.918551 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49137b9b6ae4caf91757ac5a27a074d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:22.930587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49137b9b6ae4caf91757ac5a27a074d'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:22.937454 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1418/2824] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:22 2021] DELETE /identity/v3/users/e49137b9b6ae4caf91757ac5a27a074d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:22.944228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:22.944732 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:22.944872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:22.963617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:22.964836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:23.028017 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1407/2825] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:23.038423 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:23.040116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:23.129669 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ccc6c-7c76-4459-abf1-96f64bd97353 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:23.136809 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:23.137746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:23.138162 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:23.138476 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:23.150318 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:23.151770 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:23.161607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1419/2826] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:23.432592 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:23.434026 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:23.449167 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20657-3570-46bf-99b3-32e761313d8a None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:23.454494 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:23.455516 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:23.455821 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:23.456093 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] PATH_INFO: `/v3/projects/5e4d9f5aa2b4470c8280bf3a4ee41b0e` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:23.457425 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4d9f5aa2b4470c8280bf3a4ee41b0e)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:23.459382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:23.513544 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4d9f5aa2b4470c8280bf3a4ee41b0e', 'request_id': 'req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.521782 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4d9f5aa2b4470c8280bf3a4ee41b0e', 'request_id': 'req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.527526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4d9f5aa2b4470c8280bf3a4ee41b0e', 'request_id': 'req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.538903 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] The token cache is being invalidate because project 5e4d9f5aa2b4470c8280bf3a4ee41b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:23.539184 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.539874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.541517 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1408/2827] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:23 2021] DELETE /identity/v3/projects/5e4d9f5aa2b4470c8280bf3a4ee41b0e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:23.545746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:23.555549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fe43f-8edc-458a-b833-cb93d22259a3 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:23.617164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:23.618046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:23.618322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:23.618626 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] PATH_INFO: `/v3/users/db5edd3bb9d842658bfdaf38475bfcf1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:23.619828 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5edd3bb9d842658bfdaf38475bfcf1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:23.621748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:23.670906 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5edd3bb9d842658bfdaf38475bfcf1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.678147 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5edd3bb9d842658bfdaf38475bfcf1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.678829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5edd3bb9d842658bfdaf38475bfcf1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.687658 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5edd3bb9d842658bfdaf38475bfcf1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.699442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-85cca711-f508-44b6-be00-c79fa21764d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5edd3bb9d842658bfdaf38475bfcf1'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:23.705421 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1420/2828] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:11:23 2021] DELETE /identity/v3/users/db5edd3bb9d842658bfdaf38475bfcf1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:23.980443 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:23.982087 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:23.996020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262fdeb-49f1-4dc4-9694-5f6b9e3dc5f4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.054705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.055593 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.055874 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.056148 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] PATH_INFO: `/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.057464 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef712f9639c54e5cb6de3f4336e38b8b)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.059439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.107944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef712f9639c54e5cb6de3f4336e38b8b', 'request_id': 'req-558b491e-19d4-451f-9534-7071d5f5863c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:24.116155 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef712f9639c54e5cb6de3f4336e38b8b', 'request_id': 'req-558b491e-19d4-451f-9534-7071d5f5863c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:24.121566 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef712f9639c54e5cb6de3f4336e38b8b', 'request_id': 'req-558b491e-19d4-451f-9534-7071d5f5863c'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:24.140528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] The token cache is being invalidate because project ef712f9639c54e5cb6de3f4336e38b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:11:24.140834 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:24.141938 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-558b491e-19d4-451f-9534-7071d5f5863c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:11:24.145069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1409/2829] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:11:23 2021] DELETE /identity/v3/projects/ef712f9639c54e5cb6de3f4336e38b8b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:24.153909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.154444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.154444 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.195982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:24.197110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:24.259293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1421/2830] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 23 12:11:24.267817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.268106 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.268382 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.297010 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:24.298841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:24.312173 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1410/2831] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:24.316553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.326835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24e13b-fca2-49aa-8dfd-0b6b4cc05573 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.333006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.333674 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.333955 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.334230 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] PATH_INFO: `/v3/domains` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.335016 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:11:24.335329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.337000 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.349661 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1422/2832] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:11:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:11:24.354182 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.364325 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713d53d-07bf-4d8f-9bd9-72ff4f775a11 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.370330 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.371035 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.371318 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.371588 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.372302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.374216 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.403966 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1411/2833] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:11:24 2021] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:24.408896 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.423605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35540d34-1645-450a-8bf8-5c39def97264 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.487007 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.487288 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.487571 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.487872 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] PATH_INFO: `/v3/users` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.488586 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.490555 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.516639 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1423/2834] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:11:24 2021] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:11:24.520833 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.531031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff50249-d1ff-4515-b7c5-6d525ce37ca5 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.536068 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.536731 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.537013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.537287 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.538029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.539671 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.550393 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1412/2835] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:24.555422 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.571905 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c73957-86ba-4183-87e5-c3e21c9a8a5c admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.581355 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.582025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.582305 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.582613 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.583362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.584998 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b20cee-35cc-4ce8-80f2-b60f457269e9 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.595407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1424/2836] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:11:24 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:11:24.599988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.611113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1872-277c-4b7e-95f3-25e3157b3caa admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.616899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.617791 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.618071 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.618346 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] PATH_INFO: `/v3/projects/4532116d419444a3a2ee05177f723883/users/038bb7aa7a644ad29ceaf392998257ba/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.635401 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4532116d419444a3a2ee05177f723883, user_id=038bb7aa7a644ad29ceaf392998257ba, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.638014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.651902 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1413/2837] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:11:24 2021] PUT /identity/v3/projects/4532116d419444a3a2ee05177f723883/users/038bb7aa7a644ad29ceaf392998257ba/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:11:24.709646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.710113 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.710564 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.751427 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] MFA Rules not processed for user `038bb7aa7a644ad29ceaf392998257ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:11:24.752605 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:24.820607 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1425/2838] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:11:24 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:11:24.835030 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:24.837653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:24.903843 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3527d-76d3-414b-bb58-f18219e82885 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:24.910050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:24.910718 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:24.910996 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:24.911272 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:24.920376 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:24.921818 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:24.931310 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1414/2839] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:24 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:11:55.063572 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:11:55.065165 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:55.171539 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fe1c2-731c-49a2-9c8f-5f72d28f0a37 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:11:55.178478 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:11:55.179168 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:11:55.179441 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:11:55.179745 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:11:55.181864 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:11:55.193947 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:11:55.195587 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e1746-f630-42bf-87a5-771ea1c038a2 service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:11:55.205535 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1426/2840] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:11:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:04.623206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:04.690203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9c9-d66e-48dd-8da7-54068e588067 service glance] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:04.696587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:04.697468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:04.697750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:04.698022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] PATH_INFO: `/v3/users/038bb7aa7a644ad29ceaf392998257ba` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:04.699193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038bb7aa7a644ad29ceaf392998257ba)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:04.701111 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:04.748476 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038bb7aa7a644ad29ceaf392998257ba'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:04.759335 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038bb7aa7a644ad29ceaf392998257ba'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:04.760432 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038bb7aa7a644ad29ceaf392998257ba'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:04.777053 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038bb7aa7a644ad29ceaf392998257ba'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:04.777751 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038bb7aa7a644ad29ceaf392998257ba'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:04.794851 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1415/2841] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:12:04 2021] DELETE /identity/v3/users/038bb7aa7a644ad29ceaf392998257ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:04.802216 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:04.802757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:04.802757 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:04.825160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:04.826367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:04.888829 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1427/2842] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:04.899254 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:04.900926 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:04.963533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28dd1a-8d90-4401-ac87-eef8fa3945b9 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:04.967696 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:04.968344 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:04.968626 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:04.968901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:04.978617 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:04.980029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5005d9b-e547-42ca-bcb1-e03f8280f733 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:04.990223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1416/2843] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:05.274011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.275807 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:05.287922 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ec0c-bfcd-4faa-9ca9-9b6eafe505ec None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.294024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.294909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.295192 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.295468 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] PATH_INFO: `/v3/projects/4532116d419444a3a2ee05177f723883` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.296704 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4532116d419444a3a2ee05177f723883)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.299748 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.348005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4532116d419444a3a2ee05177f723883', 'request_id': 'req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:05.359577 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4532116d419444a3a2ee05177f723883', 'request_id': 'req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:05.365699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4532116d419444a3a2ee05177f723883', 'request_id': 'req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:05.377451 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] The token cache is being invalidate because project 4532116d419444a3a2ee05177f723883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:12:05.377736 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:05.378494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-23ae0bcf-ff78-403f-8f1c-89a3c92b25fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:05.380362 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1428/2844] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:12:05 2021] DELETE /identity/v3/projects/4532116d419444a3a2ee05177f723883 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:05.386787 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.387069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.387337 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.416870 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:05.418004 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:05.492398 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1417/2845] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:05.500472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.500750 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.501020 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.520973 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:05.522156 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:05.531986 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1429/2846] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:05.536771 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.546729 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e8921-a4a8-43a9-9cfd-ecbb0e122dd7 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.552019 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.552674 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.552945 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.553218 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.553972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:12:05.554275 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.555899 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.567506 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1418/2847] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:12:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:12:05.572223 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.581368 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c824-471f-4668-b745-da3a2f8e634b None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.587495 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.588164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.588442 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.588715 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.589502 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.591443 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.622131 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1430/2848] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:12:05 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:05.628427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.639601 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f856b-baa1-4145-9fed-e63270bf2610 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.699944 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.700528 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.700814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.701090 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.701801 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.703754 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.729223 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1419/2849] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:12:05 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:05.735277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.751263 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e7ea4-9d14-4bb9-b929-c80f0f17f567 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.758025 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.758713 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.758995 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.759273 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.760005 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.761608 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.772158 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1431/2850] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:05 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:12:05.776195 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.786869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ca3d-2c18-46f4-b033-f1e01e3d75e2 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.793439 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.794100 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.794374 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.794709 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.795420 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.797008 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50191e60-b8d6-4138-8222-461df69e0728 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.808836 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1420/2851] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:12:05.815728 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.827033 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6e1b-a787-4673-b87f-8c498e2f6eb5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:05.833026 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:05.833915 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.834198 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.834472 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] PATH_INFO: `/v3/projects/4ee7f37a47cd4a0fb99b23b979a825e1/users/2075ba142c2d405ba33d48b920ff0870/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.850470 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee7f37a47cd4a0fb99b23b979a825e1, user_id=2075ba142c2d405ba33d48b920ff0870, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:05.853186 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:05.868894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1432/2852] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:12:05 2021] PUT /identity/v3/projects/4ee7f37a47cd4a0fb99b23b979a825e1/users/2075ba142c2d405ba33d48b920ff0870/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:05.881144 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:05.881427 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:05.881698 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:05.909772 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] MFA Rules not processed for user `2075ba142c2d405ba33d48b920ff0870`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:05.911247 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:05.979784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1421/2853] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:05.990688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:05.992546 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:06.084367 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfb019-9eae-41c5-afa4-36c055d840ff admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:06.089077 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:06.089775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:06.090050 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:06.090314 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:06.099806 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:06.101260 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5c24-2d8d-45f3-98dd-0e8bd1a81a64 service cinder] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:06.110769 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1433/2854] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:05 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:08.651302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:08.711616 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e015e5-b39a-432f-8ec9-624cfe38ffa2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:08.716653 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:08.717529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:08.717811 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:08.718075 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] PATH_INFO: `/v3/users/2075ba142c2d405ba33d48b920ff0870` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:08.719431 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2075ba142c2d405ba33d48b920ff0870)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:08.721334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:08.770033 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2075ba142c2d405ba33d48b920ff0870'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:08.776581 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2075ba142c2d405ba33d48b920ff0870'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:08.777235 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2075ba142c2d405ba33d48b920ff0870'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:08.789721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2075ba142c2d405ba33d48b920ff0870'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:08.790391 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2075ba142c2d405ba33d48b920ff0870'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:08.804950 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1422/2855] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:12:08 2021] DELETE /identity/v3/users/2075ba142c2d405ba33d48b920ff0870 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:08.809560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:08.810031 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:08.810142 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:08.828615 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:08.829823 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:08.897802 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1434/2856] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:08.907793 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:08.909256 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:08.980050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26536f4f-00d4-4037-894a-48a7f888b031 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:08.985022 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:08.986009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:08.986463 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:08.986961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:08.997891 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:08.999364 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f59bf-1bdc-4a7d-91f7-02df25d08275 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.009062 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1423/2857] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:09.296911 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.298630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:09.312054 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acac0dd-f91b-4119-8093-e79c91dd68b3 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.318096 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.319175 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.319450 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.319716 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] PATH_INFO: `/v3/projects/4ee7f37a47cd4a0fb99b23b979a825e1` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.321276 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee7f37a47cd4a0fb99b23b979a825e1)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.323247 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.371853 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee7f37a47cd4a0fb99b23b979a825e1', 'request_id': 'req-1a62f1a9-3611-419c-8544-29157081a2e0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:09.380520 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee7f37a47cd4a0fb99b23b979a825e1', 'request_id': 'req-1a62f1a9-3611-419c-8544-29157081a2e0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:09.386204 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee7f37a47cd4a0fb99b23b979a825e1', 'request_id': 'req-1a62f1a9-3611-419c-8544-29157081a2e0'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:09.398006 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] The token cache is being invalidate because project 4ee7f37a47cd4a0fb99b23b979a825e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:12:09.398291 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:09.398944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-1a62f1a9-3611-419c-8544-29157081a2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:12:09.400523 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1435/2858] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:12:09 2021] DELETE /identity/v3/projects/4ee7f37a47cd4a0fb99b23b979a825e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:09.407005 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.407228 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.407507 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.425350 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:09.426575 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:09.486447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1424/2859] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:09.494838 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.495130 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.495436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.515691 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:09.516898 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:09.525997 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1436/2860] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:09.530383 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.540201 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1528f4-995e-481a-ac8f-f8f62b523dc2 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.545118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.545769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.546049 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.546323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] PATH_INFO: `/v3/domains` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.547112 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 23 12:12:09.547415 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.549013 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.560556 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1425/2861] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Dec 23 12:12:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 23 12:12:09.564880 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.574773 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d16bb-a4bc-4326-b85d-a9c9926fdac8 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.580397 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.581028 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.581325 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.581560 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.582252 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.584417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.619110 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1437/2862] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:12:09 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:09.625706 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.638206 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e5aa-49c6-466a-933c-1c1dc727f53c admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.703925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.704650 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.704855 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.705098 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.706203 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.709065 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.729515 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1426/2863] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:12:09 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:09.734078 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.744332 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a981e5b-0da4-4975-9298-65171b337cb4 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.749086 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.749738 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.750014 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.750283 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.751076 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.752670 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.762810 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1438/2864] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:12:09.766781 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.776799 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6fff1-030a-4a6c-8674-ff3048a4fa99 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.782032 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.782737 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.783020 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.783294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.784041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.785689 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49430610-a77d-4ed0-9ce1-d19071e05ff0 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.796555 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1427/2865] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:12:09.800645 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.811222 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5ad43-d83f-4760-bbaa-2ec18a8de2ef admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:09.816974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:09.818185 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.818469 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.818779 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] PATH_INFO: `/v3/projects/261f3dd2fce84f6ba9012d9b2b7b8820/users/12e2a6e84ef54db284199ad0d460ca49/roles/f1a3aae1c2fd48f5acf67dee2a2532ed` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.834760 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261f3dd2fce84f6ba9012d9b2b7b8820, user_id=12e2a6e84ef54db284199ad0d460ca49, role_id=f1a3aae1c2fd48f5acf67dee2a2532ed)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:09.837438 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:09.853514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1439/2866] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:12:09 2021] PUT /identity/v3/projects/261f3dd2fce84f6ba9012d9b2b7b8820/users/12e2a6e84ef54db284199ad0d460ca49/roles/f1a3aae1c2fd48f5acf67dee2a2532ed => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:09.859031 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e745fc-306b-4711-a7f9-3eb5802ff648 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:09.859324 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e745fc-306b-4711-a7f9-3eb5802ff648 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:09.859605 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e745fc-306b-4711-a7f9-3eb5802ff648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:09.877646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-46e745fc-306b-4711-a7f9-3eb5802ff648 None None] MFA Rules not processed for user `9398b24434c441718ba35a7f98df482a`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:09.878878 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-46e745fc-306b-4711-a7f9-3eb5802ff648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:09.947909 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1428/2867] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:09.958582 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:09.960591 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:10.025227 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406791c-f791-4298-92a5-9a951f252dc5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:10.029693 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:10.030343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:10.030656 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:10.030927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:10.040909 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:10.042345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:10.052609 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1440/2868] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:13.927082 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:13.927627 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:13.927743 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:13.957535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.auth.core [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] MFA Rules not processed for user `12e2a6e84ef54db284199ad0d460ca49`. Rule list: `[]` (Enabled: `True`). {{(pid=79189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:13.958750 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:14.024769 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1429/2869] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:14.029432 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.039573 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bf177-2a81-41f4-9042-70c11de3a159 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.044128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.044791 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.045071 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.045344 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.046043 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.047982 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.074869 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1441/2870] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Dec 23 12:12:14 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:14.079018 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.090323 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c25daa-300b-4f44-98b8-36583bf58629 None None] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.172417 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.173231 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] REQUEST_METHOD: `POST` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.173535 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.173810 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] PATH_INFO: `/v3/users` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.174587 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.176525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.199438 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1430/2871] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Dec 23 12:12:14 2021] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 23 12:12:14.203522 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.215646 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1178-0b40-4077-973d-67af7ab4d4a8 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.220487 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.221269 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.221635 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.221974 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.222857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.224944 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.237011 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1442/2872] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 23 12:12:14.242972 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.253435 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471b77-079c-4486-bad2-e5179e4d7966 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.258642 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.259558 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.259837 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.260118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] PATH_INFO: `/v3/projects/951d26886e0a47f687365cd4bf764b96/users/0f3959ba9e8b457a8176063da6e0e511/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.276907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] RBAC: Authorizing `identity:create_grant(project_id=951d26886e0a47f687365cd4bf764b96, user_id=0f3959ba9e8b457a8176063da6e0e511, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.279618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.295317 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1431/2873] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:12:14 2021] PUT /identity/v3/projects/951d26886e0a47f687365cd4bf764b96/users/0f3959ba9e8b457a8176063da6e0e511/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:14.299514 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.310485 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8cb30-bd74-480c-a4b4-246ab6e63336 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.369190 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.369876 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.370164 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.370437 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] PATH_INFO: `/v3/roles` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.371219 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.372848 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae0333-f9d0-4a10-8f71-1bc439fda68e admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.384417 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1443/2874] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Dec 23 12:12:14 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 23 12:12:14.388777 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:14.399302 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5fc5c-05c7-49a6-a424-1d20b1d9451e admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:14.403969 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:14.404873 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:14.405149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:14.405416 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] PATH_INFO: `/v3/projects/951d26886e0a47f687365cd4bf764b96/users/0f3959ba9e8b457a8176063da6e0e511/roles/00fb2e201ac64cd3b6dd6add80bbad1a` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:14.407551 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951d26886e0a47f687365cd4bf764b96, user_id=0f3959ba9e8b457a8176063da6e0e511, role_id=00fb2e201ac64cd3b6dd6add80bbad1a)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:14.410175 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:14.421143 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1432/2875] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Dec 23 12:12:14 2021] PUT /identity/v3/projects/951d26886e0a47f687365cd4bf764b96/users/0f3959ba9e8b457a8176063da6e0e511/roles/00fb2e201ac64cd3b6dd6add80bbad1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:12:19.040387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdf03-fcd3-41d1-9d6f-6497e6a83fa4 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:19.041267 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdf03-fcd3-41d1-9d6f-6497e6a83fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:19.041737 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bdf03-fcd3-41d1-9d6f-6497e6a83fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:19.069835 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-9d3bdf03-fcd3-41d1-9d6f-6497e6a83fa4 None None] MFA Rules not processed for user `0f3959ba9e8b457a8176063da6e0e511`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:19.071617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-9d3bdf03-fcd3-41d1-9d6f-6497e6a83fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:19.144342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1444/2876] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:19 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:19.157808 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:19.159742 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:19.217342 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070659-8d8b-447c-a509-639a384d9ae7 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:19.221386 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '049a0120570d4d6e94d4d10a7460226d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:19.222048 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:19.222352 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:19.222665 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:19.293970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:19.295468 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:19.304572 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1433/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:19 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:19.420060 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ed73-9d41-4545-8591-efdd2195cea1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:19.420369 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ed73-9d41-4545-8591-efdd2195cea1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:19.420630 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ed73-9d41-4545-8591-efdd2195cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:19.454861 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-a452ed73-9d41-4545-8591-efdd2195cea1 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:19.456788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a452ed73-9d41-4545-8591-efdd2195cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:19.531548 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1445/2878] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:12:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:19.587540 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:19.589399 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:19.682028 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c132631-3e2b-4f1f-b98c-2b09a2b814de service glance] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:19.691739 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:19.692608 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:19.692885 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:19.693156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:19.702113 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:19.703738 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:19.712931 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1434/2879] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:12:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:12:28.716659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9f2d-48e7-4b63-8ca8-e3bc4f076157 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:28.717212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9f2d-48e7-4b63-8ca8-e3bc4f076157 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:28.717212 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9f2d-48e7-4b63-8ca8-e3bc4f076157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:28.741063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d43b9f2d-48e7-4b63-8ca8-e3bc4f076157 None None] MFA Rules not processed for user `12e2a6e84ef54db284199ad0d460ca49`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:28.742272 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d43b9f2d-48e7-4b63-8ca8-e3bc4f076157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:28.750160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1446/2880] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:12:28 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:29.045814 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:29.047486 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:29.118525 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da177-c9bb-4228-926f-fa6c18da87c6 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:29.123308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:29.124334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:29.124784 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:29.125156 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:29.127652 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:29.139477 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:29.141007 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:29.149529 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1435/2881] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:12:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:12:31.030465 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:31.031024 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:31.031160 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:31.050774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:12:31.052089 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:12:31.060293 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1447/2882] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Dec 23 12:12:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:12:31.073533 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:12:31.086526 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0ea23-67a3-4db9-94b8-9f0586c2811b service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:12:31.092091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:12:31.092746 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:12:31.093029 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:12:31.093301 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:12:31.102037 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:12:31.103660 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:12:31.112059 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1436/2883] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:12:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:13:01.193002 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:01.204534 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598279e3-1676-47e9-bb92-84d54e450fb1 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:01.209637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:01.210287 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:01.210610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:01.210927 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:01.220553 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:01.222046 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90009256-48ff-408e-8084-bd464193ce95 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:01.231903 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1448/2884] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:01 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:13:21.691749 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:21.694124 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:21.754651 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b7c10-4cbb-4bfc-8413-781ceb76f1cd service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:21.758979 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16cff1dd38b24c53b75703647fddd213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:21.759628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:21.759907 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:21.760180 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:21.762050 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:21.820294 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:21.821860 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:21.831549 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1437/2885] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:21 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:13:29.718254 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:29.718858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:29.718858 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:29.736977 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] MFA Rules not processed for user `28fb997ba3e94ce4a7cff5d5efe7d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:13:29.738210 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:29.745868 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1449/2886] 10.222.0.65 () {58 vars in 957 bytes} [Thu Dec 23 12:13:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:13:33.025654 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:33.036434 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19040aef-f814-4d6a-8cc0-58d2193131da service cinder] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:33.040918 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:33.041586 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:33.041872 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:33.042333 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:33.045191 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:33.133574 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:33.135083 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:33.155610 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1438/2887] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:13:35.701326 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:35.712119 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d901d9-44a5-491e-9689-6c5618ebf9a0 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:35.717009 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:35.717652 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:35.717930 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:35.718197 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:35.720636 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:35.736660 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:35.738095 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:35.749863 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1450/2888] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:13:45.104245 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:45.113475 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfaee1-c6cb-4e8a-9b7e-e7d57f643b6b service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:45.117956 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:45.118618 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:45.118928 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:45.119193 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:45.121234 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:45.136458 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:45.138493 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:45.150646 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1439/2889] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:13:47.972857 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:13:47.982686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f201c-211a-4702-9f60-2e99574b8006 service neutron] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:13:47.987554 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:13:47.988844 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:13:47.989128 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:13:47.989418 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:13:47.991811 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:13:48.059191 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:13:48.060688 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4c91f-bb99-471a-83fd-00f679fb1efc service neutron] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:13:48.070500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1451/2890] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:13:47 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 23 12:14:53.389854 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:14:53.391331 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:14:53.423142 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aeeea-3774-4280-bd29-5c0ad9e85227 service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:14:53.436296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:14:53.437440 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:14:53.438076 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:14:53.438580 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:14:53.441061 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:14:53.457797 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:14:53.460269 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:14:53.479149 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1440/2891] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:14:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:15:02.407085 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] REQUEST_METHOD: `POST` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:02.407549 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:02.407659 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:02.463003 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.auth.core [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] MFA Rules not processed for user `95d72db4299b40cba45b3db1bc835939`. Rule list: `[]` (Enabled: `True`). {{(pid=79190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 23 12:15:02.464173 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:02.483322 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1452/2892] 10.222.0.65 () {58 vars in 967 bytes} [Thu Dec 23 12:15:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 23 12:15:02.526989 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:02.549289 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad9f9-ebee-497a-a9c3-451151c16515 service nova] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:02.555715 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b3428dc311404ba2f0dffa002d5ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:02.556345 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:02.556628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:02.556877 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:02.565911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:02.567502 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:02.575766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1441/2893] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Dec 23 12:15:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 23 12:15:09.253114 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:09.325289 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c8068-8e2e-4904-890a-b17a5430e159 None None] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:09.329759 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:09.330686 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:09.330969 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:09.331240 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] PATH_INFO: `/v3/users/12e2a6e84ef54db284199ad0d460ca49` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:09.332436 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e2a6e84ef54db284199ad0d460ca49)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:09.334359 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:09.381692 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e2a6e84ef54db284199ad0d460ca49'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.388428 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e2a6e84ef54db284199ad0d460ca49'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.389100 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e2a6e84ef54db284199ad0d460ca49'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.396673 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e2a6e84ef54db284199ad0d460ca49'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.412990 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e2a6e84ef54db284199ad0d460ca49'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.420529 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1453/2894] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:15:09 2021] DELETE /identity/v3/users/12e2a6e84ef54db284199ad0d460ca49 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:15:09.604761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:09.616385 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c7cba-d952-44a0-ad64-bd438c563cc6 service swift] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:09.675219 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:09.676091 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:09.676368 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:09.676641 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] PATH_INFO: `/v3/projects/261f3dd2fce84f6ba9012d9b2b7b8820` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:09.677889 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261f3dd2fce84f6ba9012d9b2b7b8820)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:09.679817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:09.733378 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261f3dd2fce84f6ba9012d9b2b7b8820', 'request_id': 'req-354a5e1c-86a6-44bf-935e-a127ff36b7e4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.741395 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261f3dd2fce84f6ba9012d9b2b7b8820', 'request_id': 'req-354a5e1c-86a6-44bf-935e-a127ff36b7e4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.747296 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261f3dd2fce84f6ba9012d9b2b7b8820', 'request_id': 'req-354a5e1c-86a6-44bf-935e-a127ff36b7e4'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.762118 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] The token cache is being invalidate because project 261f3dd2fce84f6ba9012d9b2b7b8820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:15:09.762400 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.763069 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.764644 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1442/2895] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:15:09 2021] DELETE /identity/v3/projects/261f3dd2fce84f6ba9012d9b2b7b8820 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:15:09.768783 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:09.770412 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:09.783796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9d2ff-997e-4e62-9dda-b1e913654094 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:09.846379 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:09.847213 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:09.847500 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:09.847774 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] PATH_INFO: `/v3/users/0f3959ba9e8b457a8176063da6e0e511` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:09.849152 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3959ba9e8b457a8176063da6e0e511)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:09.851151 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:09.908552 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3959ba9e8b457a8176063da6e0e511'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.915617 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3959ba9e8b457a8176063da6e0e511'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.916335 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3959ba9e8b457a8176063da6e0e511'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.924010 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3959ba9e8b457a8176063da6e0e511'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.936242 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3959ba9e8b457a8176063da6e0e511'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:09.942149 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1454/2896] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:15:09 2021] DELETE /identity/v3/users/0f3959ba9e8b457a8176063da6e0e511 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 23 12:15:10.114901 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:10.116375 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:10.129766 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a5e1c-86a6-44bf-935e-a127ff36b7e4 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:10.186429 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:10.187327 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:10.187611 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:10.187884 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] PATH_INFO: `/v3/projects/951d26886e0a47f687365cd4bf764b96` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:10.189080 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951d26886e0a47f687365cd4bf764b96)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:10.191021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:10.248447 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951d26886e0a47f687365cd4bf764b96', 'request_id': 'req-3d849224-18ff-4c28-8302-fae3028e7c39'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:10.258014 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951d26886e0a47f687365cd4bf764b96', 'request_id': 'req-3d849224-18ff-4c28-8302-fae3028e7c39'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:10.263925 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951d26886e0a47f687365cd4bf764b96', 'request_id': 'req-3d849224-18ff-4c28-8302-fae3028e7c39'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:10.275761 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] The token cache is being invalidate because project 951d26886e0a47f687365cd4bf764b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:15:10.276041 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:10.276817 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:15:10.278469 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1443/2897] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:15:10 2021] DELETE /identity/v3/projects/951d26886e0a47f687365cd4bf764b96 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:15:40.099875 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:40.101329 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:40.193647 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbafc7-9935-4b66-9d1a-cdde16c50fcb admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:40.260682 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a96bba0782248589ec206a1c8c9747e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:40.261342 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:40.261620 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:40.261894 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:40.263796 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:40.276116 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:40.277794 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:40.288878 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1455/2898] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:15:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:15:54.840164 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:15:54.841700 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:54.900334 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849224-18ff-4c28-8302-fae3028e7c39 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:15:54.904066 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec66b04133444ff889865e3943181507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:15:54.904707 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] REQUEST_METHOD: `GET` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:15:54.904988 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:15:54.905260 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:15:54.907217 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:15:54.971263 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:15:54.972714 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:15:54.983181 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1444/2899] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:15:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 23 12:16:01.161206 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:16:01.163471 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:16:01.184343 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd52057-422b-4fd5-a394-4ef96f279176 service nova] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:16:01.189194 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:16:01.190094 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:16:01.191012 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:16:01.191345 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] PATH_INFO: `/v3/users/28fb997ba3e94ce4a7cff5d5efe7d4b2` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:16:01.192515 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=28fb997ba3e94ce4a7cff5d5efe7d4b2)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:16:01.195637 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:16:01.248398 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28fb997ba3e94ce4a7cff5d5efe7d4b2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.255486 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28fb997ba3e94ce4a7cff5d5efe7d4b2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.256348 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28fb997ba3e94ce4a7cff5d5efe7d4b2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.264352 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28fb997ba3e94ce4a7cff5d5efe7d4b2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.276494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28fb997ba3e94ce4a7cff5d5efe7d4b2'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.283104 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1456/2900] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:16:01 2021] DELETE /identity/v3/users/28fb997ba3e94ce4a7cff5d5efe7d4b2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:16:01.456849 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:16:01.469804 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba44d-c937-484b-beb1-5df523e1c06c service neutron] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:16:01.538101 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:16:01.539034 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:16:01.539308 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:16:01.539591 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] PATH_INFO: `/v3/projects/65754771daec4e08922a4c10f20ca653` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:16:01.540904 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65754771daec4e08922a4c10f20ca653)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:16:01.542841 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:16:01.592270 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65754771daec4e08922a4c10f20ca653', 'request_id': 'req-1bf0bf39-430e-43a9-8fc3-5ee259088d08'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.600085 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65754771daec4e08922a4c10f20ca653', 'request_id': 'req-1bf0bf39-430e-43a9-8fc3-5ee259088d08'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.605705 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65754771daec4e08922a4c10f20ca653', 'request_id': 'req-1bf0bf39-430e-43a9-8fc3-5ee259088d08'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.618628 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] The token cache is being invalidate because project 65754771daec4e08922a4c10f20ca653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:16:01.618908 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.619684 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.621396 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1445/2901] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:16:01 2021] DELETE /identity/v3/projects/65754771daec4e08922a4c10f20ca653 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:16:01.626589 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:16:01.628643 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:16:01.642387 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ad7c-12cc-468c-b7e9-9a894fabdbbd admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:16:01.702407 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:16:01.703225 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:16:01.703510 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:16:01.703788 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] PATH_INFO: `/v3/users/fcb78138ca084b00a88919040c3bb23c` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:16:01.705063 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb78138ca084b00a88919040c3bb23c)` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:16:01.707051 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:16:01.761566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb78138ca084b00a88919040c3bb23c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.768610 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb78138ca084b00a88919040c3bb23c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.769277 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb78138ca084b00a88919040c3bb23c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.777566 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb78138ca084b00a88919040c3bb23c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.790249 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.notifications [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb78138ca084b00a88919040c3bb23c'} {{(pid=79190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:01.796337 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1457/2902] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Dec 23 12:16:01 2021] DELETE /identity/v3/users/fcb78138ca084b00a88919040c3bb23c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:16:01.977121 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Authenticating user token {{(pid=79189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:16:01.979961 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.fernet_utils [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:16:01.998011 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0bf39-430e-43a9-8fc3-5ee259088d08 admin admin] Validating token access rules against request {{(pid=79189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:16:02.058009 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9398b24434c441718ba35a7f98df482a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '174ef43af8a44f289a307527e69c1f4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:16:02.059021 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:16:02.059371 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:16:02.059673 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] PATH_INFO: `/v3/projects/220bc21aa090477f9caf3e52e18c1664` {{(pid=79189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:16:02.060911 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220bc21aa090477f9caf3e52e18c1664)` {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:16:02.062869 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] RBAC: Authorization granted {{(pid=79189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:16:02.110389 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220bc21aa090477f9caf3e52e18c1664', 'request_id': 'req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:02.119662 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220bc21aa090477f9caf3e52e18c1664', 'request_id': 'req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:02.126913 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220bc21aa090477f9caf3e52e18c1664', 'request_id': 'req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49'} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:02.140721 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] The token cache is being invalidate because project 220bc21aa090477f9caf3e52e18c1664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 23 12:16:02.141252 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:02.141970 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: DEBUG keystone.notifications [None req-f71704c6-8a0c-4b5e-8017-c8c87d9b4d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 23 12:16:02.143666 dv-cinder-822821-1-iscsi devstack@keystone.service[79189]: [pid: 79189|app: 0|req: 1446/2903] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Dec 23 12:16:01 2021] DELETE /identity/v3/projects/220bc21aa090477f9caf3e52e18c1664 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 23 12:17:03.069188 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Authenticating user token {{(pid=79190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 23 12:17:03.071350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:17:03.149699 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7becaa5-396b-41a7-bf2d-7c79fbcd55f5 admin admin] Validating token access rules against request {{(pid=79190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 23 12:17:03.215847 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6966386b0f049b69806233e9a0157ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa91e246db04e09aa78ae146a965727', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 23 12:17:03.216494 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] REQUEST_METHOD: `GET` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 23 12:17:03.216776 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] SCRIPT_NAME: `/identity` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 23 12:17:03.217053 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 23 12:17:03.219070 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.fernet_utils [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 23 12:17:03.230746 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 23 12:17:03.232775 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320f7b-d510-48ca-944e-fedbbef33a6d service placement] RBAC: Authorization granted {{(pid=79190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 23 12:17:03.243350 dv-cinder-822821-1-iscsi devstack@keystone.service[79190]: [pid: 79190|app: 0|req: 1458/2904] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Dec 23 12:17:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)